-- Logs begin at Wed 2022-11-02 11:43:19 UTC, end at Wed 2022-11-02 12:48:30 UTC. -- Nov 02 12:20:07.189513 dv-cinder-863273-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:20:07.199058 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:20:07 2022] *** Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: nodename: dv-cinder-863273-1-iscsi Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: machine: x86_64 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: clock source: unix Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: pcre jit disabled Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: detected number of CPU cores: 4 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: current working directory: / Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: your processes number limit is 47680 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: your memory page size is 4096 bytes Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: detected max file descriptor number: 2048 Nov 02 12:20:07.201300 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: lock engine: pthread robust mutexes Nov 02 12:20:07.202125 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: thunder lock: enabled Nov 02 12:20:07.202125 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:20:07.202125 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:20:07.241586 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: Python main interpreter initialized at 0x555a772be9c0 Nov 02 12:20:07.241586 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: python threads support enabled Nov 02 12:20:07.241586 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: your server socket listen backlog is limited to 100 connections Nov 02 12:20:07.241586 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:20:07.242048 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:20:07.242048 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: *** Operational MODE: preforking *** Nov 02 12:20:07.242310 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:20:07.242310 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: spawned uWSGI master process (pid: 105533) Nov 02 12:20:07.242528 dv-cinder-863273-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:20:07.243643 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: spawned uWSGI worker 1 (pid: 105534, cores: 1) Nov 02 12:20:07.243643 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: spawned uWSGI worker 2 (pid: 105535, cores: 1) Nov 02 12:20:07.243643 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:20:07.924305 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:20:07.924878 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:20:09.023170 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:20:09.023170 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: from cryptography.utils import int_from_bytes Nov 02 12:20:09.023906 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:20:09.023906 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: from cryptography.utils import int_from_bytes Nov 02 12:20:09.026553 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:20:09.026553 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: from cryptography.utils import int_from_bytes Nov 02 12:20:09.026995 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:20:09.026995 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: from cryptography.utils import int_from_bytes Nov 02 12:20:11.581561 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:20:11.582131 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:20:11.582499 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:20:11.582596 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:20:11.582666 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:20:11.582732 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:20:11.582806 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:20:11.582881 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:20:11.582948 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:20:11.583013 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:20:11.583330 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.583440 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.583629 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.583727 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.583970 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584061 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584272 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584599 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584687 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.584908 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585023 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585275 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585369 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585569 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585661 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585898 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.585995 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586156 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586243 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586472 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586563 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586792 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863273-1-iscsi {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.586878 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863273-1-iscsi {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587110 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587243 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587415 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587509 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587728 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.587823 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588045 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588130 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588348 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588432 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588666 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588760 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.588969 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.589085 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.589506 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.590109 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.590498 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.590624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.590808 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.590930 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591124 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591421 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591516 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591598 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591766 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.591862 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592074 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592160 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592393 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592522 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592701 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.592836 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593043 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593147 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593359 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593506 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593769 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863273-1-iscsi {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.593979 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863273-1-iscsi {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.594114 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.594273 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.594429 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.594683 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.594826 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595035 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595180 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595500 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595636 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595779 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.595921 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596077 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596233 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596374 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596514 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596675 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596815 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.596955 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597148 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597292 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597438 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597584 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597745 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597855 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.597943 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598138 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598260 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598452 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598599 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598755 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.598925 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599069 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599211 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599351 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599492 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599660 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599801 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.599935 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600084 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600239 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600430 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600596 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600737 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.600895 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601074 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601232 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601399 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601550 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601704 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601847 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.601995 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602151 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602296 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602296 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602571 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602732 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.602873 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603041 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603184 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603326 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603476 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603615 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603771 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.603923 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.604071 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.604410 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.604510 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.604675 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.604844 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.605013 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.605168 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.605349 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606032 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606186 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606353 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606501 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606645 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606789 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.606930 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607072 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607248 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607408 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607614 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607759 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.607908 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608051 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608215 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608382 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608494 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608564 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608643 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608783 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.608921 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609170 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609301 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609429 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609556 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609774 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.609912 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610046 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610195 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610338 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610479 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610690 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610841 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.610984 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611144 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611289 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611429 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611584 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611738 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.611880 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612029 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612179 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612313 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612470 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612625 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612779 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.612918 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613096 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613096 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613393 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613555 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613712 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613849 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.613988 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614156 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614359 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614598 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614758 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614901 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.614901 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615179 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615332 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615481 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615621 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615765 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.615920 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616062 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616203 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616347 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616492 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616583 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616742 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.616885 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617107 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617257 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617401 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617562 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617781 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.617927 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618091 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618091 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618360 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618682 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618827 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.618985 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619128 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619274 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619431 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619682 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619828 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.619983 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.620126 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.620280 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.620423 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.620582 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.620782 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621015 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621180 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621323 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621465 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621620 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621775 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.621922 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622049 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622182 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622271 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622418 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622563 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622707 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622855 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.622996 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623148 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623148 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623437 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623574 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623714 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.623852 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624005 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624155 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624293 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624496 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624734 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.624879 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625073 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625218 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625360 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625660 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625815 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.625973 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626126 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626268 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626426 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626569 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626716 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626876 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.626876 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.627148 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.627287 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.627431 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.627592 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.627737 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.627881 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:20:11.628030 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628174 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628340 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628502 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628647 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628790 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.628933 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629142 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629291 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629463 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629623 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629786 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.629930 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630073 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630228 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630369 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630510 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630652 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630796 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.630796 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631077 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631077 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631344 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631487 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631669 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631829 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.631989 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632144 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632295 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632435 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632576 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632576 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.632854 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633081 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633248 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633397 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633541 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633686 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633844 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.633990 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634146 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634308 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634460 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634626 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634850 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.634999 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635152 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635296 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635440 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635598 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635742 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.635886 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636187 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636335 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636492 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636637 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636780 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.636924 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.637107 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.637518 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.637685 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.637831 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.637977 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638139 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638286 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638430 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638589 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638734 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.638879 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639043 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639190 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639345 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639499 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639640 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639783 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.639929 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640084 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640240 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640383 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640528 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640671 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640829 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.640983 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641220 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641367 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641511 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641666 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641811 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.641960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642213 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642355 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642498 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642640 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642780 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.642921 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643077 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643232 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643376 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643661 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643819 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.643977 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644122 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644265 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644410 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644554 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644712 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.644937 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645124 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645273 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645417 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645562 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645728 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.645873 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646018 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646163 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646310 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646438 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646598 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646755 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.646899 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647043 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647188 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647353 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647511 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647653 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647793 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.647937 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648077 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648233 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648374 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648515 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648667 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648808 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.648968 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649173 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649321 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649467 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649591 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649712 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.649867 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650022 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650164 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650304 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650447 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650591 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650750 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.650895 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651038 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651179 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651320 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651474 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651637 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651793 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.651957 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.652106 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.652676 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.652782 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.652939 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653105 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653269 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653413 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653560 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653705 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.653869 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654013 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654157 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654298 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654448 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654610 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654756 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.654901 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655051 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655221 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655360 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655660 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655806 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.655955 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656126 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656278 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656443 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656597 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656739 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.656881 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657077 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657253 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657413 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657563 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657680 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.657891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658036 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658194 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658338 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658629 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658772 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.658915 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659071 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659236 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659377 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659518 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659662 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659809 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.659971 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660097 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660215 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660358 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660667 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660823 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.660978 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661204 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661346 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661486 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661644 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661788 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.661937 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662080 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662221 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662374 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662534 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662677 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662839 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.662983 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663144 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663318 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663476 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663620 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663762 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.663911 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664116 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664260 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664416 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664559 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664702 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664847 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.664991 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.665259 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.665464 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.665613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.665754 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.665899 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666053 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666219 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666376 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666520 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666665 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666818 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.666962 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.667119 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.667274 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.667416 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.667555 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.667698 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.668498 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.668667 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.668792 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.668891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669138 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669286 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669448 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669615 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669773 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.669918 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670061 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670203 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670369 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670513 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670654 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670794 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.670938 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671082 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671336 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671449 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671582 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671737 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.671880 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672023 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672194 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672340 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672486 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672628 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672765 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.672907 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673088 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673232 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673433 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673589 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673735 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.673899 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674046 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674252 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674405 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674547 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674691 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.674847 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675002 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675145 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675274 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675414 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675572 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675731 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.675870 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676010 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676152 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676293 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676436 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676592 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676747 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.676891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677058 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677220 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677380 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677525 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677668 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677820 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.677967 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678174 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678352 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678497 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678638 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678792 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.678935 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679080 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679244 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679389 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679534 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679680 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679825 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.679970 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680127 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680271 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680426 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680568 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680721 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.680867 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681055 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681216 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681374 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681528 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681687 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.681852 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682006 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682166 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682311 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682454 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682599 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682740 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.682884 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683025 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683149 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683546 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683714 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683852 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.683989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684127 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684316 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684455 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684604 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684743 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.684893 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685105 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685247 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685405 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685674 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685810 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.685957 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686107 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686257 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686394 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686540 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686688 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686846 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.686999 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687159 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687305 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687447 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687601 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687758 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.687898 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688056 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688253 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688410 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688553 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688692 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688904 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.688904 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689157 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689444 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689444 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689724 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.689880 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690022 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690165 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690316 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690471 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690634 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690797 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.690951 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691095 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691238 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691380 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691574 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691735 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.691925 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692094 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692250 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692401 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692545 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692698 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.692855 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693053 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693205 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693352 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693490 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693653 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.693959 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694113 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694257 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694449 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694598 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694850 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.694994 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695137 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695279 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695420 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695575 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695700 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695839 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.695982 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696123 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696270 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696422 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696514 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696643 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696790 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.696947 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697134 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697301 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697445 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697585 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697726 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.697877 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698021 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698179 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698398 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698548 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698699 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.698848 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699096 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699243 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699385 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699527 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699669 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699827 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.699983 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700124 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700261 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700395 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700534 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700677 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700844 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.700985 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.701272 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.701420 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.701575 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.701734 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.701880 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702041 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702184 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702330 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702469 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702628 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702765 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.702918 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703058 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703198 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703349 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703505 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703714 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.703864 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704011 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704160 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704259 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704352 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704496 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704566 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704848 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.704961 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705179 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705327 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705469 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705600 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705793 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.705928 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706051 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706180 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706356 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706476 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706630 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706732 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.706944 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707092 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707268 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707409 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707556 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707689 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.707899 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708019 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708162 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708414 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708550 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708647 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708779 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.708937 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709118 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709426 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709582 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709725 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.709891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710026 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710200 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710332 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710508 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710646 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710826 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.710951 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711179 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711378 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711519 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711654 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711831 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.711990 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712152 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712287 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712458 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712548 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712769 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.712857 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713101 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713211 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713409 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713497 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713711 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.713798 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.714022 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.714112 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.714327 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.714428 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715138 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715283 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715449 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715754 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.715890 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716059 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716156 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716370 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716458 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716677 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716765 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.716980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717100 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717308 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717400 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717615 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717738 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.717916 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718013 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718223 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718311 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718649 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718866 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.718964 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719180 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719269 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719490 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719578 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719851 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.719961 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720110 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720197 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720421 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720508 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720727 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.720818 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721067 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721159 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721384 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721473 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721698 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.721788 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722005 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722092 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722309 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722397 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722633 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.722950 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723044 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723259 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723356 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723579 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723670 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.723896 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724005 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724213 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724311 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724517 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724604 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724820 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.724914 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725155 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725258 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725470 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725567 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725780 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.725868 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726095 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726201 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726411 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726509 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726726 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.726823 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727033 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727129 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727343 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727437 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727655 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727749 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.727959 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728055 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728269 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728356 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728584 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.728895 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729020 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729232 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729417 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729575 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729677 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729892 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.729984 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.730233 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.730358 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731087 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731178 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731406 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731494 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731716 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.731811 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732023 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732160 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732353 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732478 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732670 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732792 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.732979 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733142 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733318 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733433 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733630 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733730 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.733947 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734049 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734257 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734345 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734668 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734769 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.734999 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735100 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735315 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735445 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735625 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735713 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.735941 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736045 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736251 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736346 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736555 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736643 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736868 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.736957 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737201 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737289 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737530 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737619 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737838 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.737927 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738145 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738234 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738475 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738571 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738784 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.738893 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739104 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739214 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739480 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739592 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739808 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.739898 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740118 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740216 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740426 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740523 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740733 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.740822 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741082 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741187 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741393 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741495 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741719 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.741806 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742151 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742246 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742463 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742649 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742769 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.742871 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743081 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743191 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743406 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743516 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743732 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.743833 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744050 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744151 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744371 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744478 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744679 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.744796 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745026 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745116 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745364 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745453 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745687 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.745810 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.749942 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.750092 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.750092 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.752934 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753225 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753318 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753389 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753590 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753674 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753754 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.753833 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755037 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755140 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755225 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755306 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755400 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755587 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755587 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755769 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755839 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.755921 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756002 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756070 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756138 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756204 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756270 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756349 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756418 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756558 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756625 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756692 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756766 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.756841 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757160 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757266 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757353 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757433 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757501 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757568 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757633 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757766 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.757891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758046 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758182 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758289 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758386 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758470 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758551 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758655 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758746 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758829 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.758917 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759044 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759179 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759345 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759488 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759631 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759778 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759889 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.759986 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760132 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760233 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760318 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760407 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760489 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760579 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760661 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760741 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760821 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760901 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.760989 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761120 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761220 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761309 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761390 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761469 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761549 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761639 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761722 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761809 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761897 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.761978 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762071 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762153 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762485 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762570 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762650 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762730 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762823 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762913 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.762994 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763081 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763180 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763263 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763354 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763435 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763515 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763594 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763674 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763754 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763843 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.763925 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764019 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764236 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764328 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764425 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764508 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764589 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764669 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764749 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.764829 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765010 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765098 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765172 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765271 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765362 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765490 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765588 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765679 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765761 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765885 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.765885 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766042 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766143 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766228 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766308 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766402 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766491 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766581 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766663 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766742 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766822 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.766901 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767064 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767228 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767382 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767571 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767701 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.767928 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768026 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768247 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768337 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768586 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768675 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.768914 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769040 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769266 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769518 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769608 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769852 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.769943 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770171 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770251 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770487 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770564 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770802 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.770888 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771119 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771205 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771452 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771756 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.771902 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772055 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772159 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772371 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772616 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772707 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.772955 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773128 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773305 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773396 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773627 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773719 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.773951 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774051 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774279 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774406 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774593 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774693 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.774909 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775009 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775223 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775339 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775581 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775718 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775912 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.775999 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776237 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776336 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776551 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776650 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776869 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.776965 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.777727 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.777827 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778090 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778194 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778413 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778514 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778731 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.778820 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779046 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779136 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779364 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779461 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779676 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779764 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.779992 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780081 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780307 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780396 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780623 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780725 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.780944 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781070 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781290 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781386 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781603 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781699 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.781923 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782087 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782246 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782386 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782534 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782767 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.782910 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783087 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783229 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783424 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783575 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783754 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.783848 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784083 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784236 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784397 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784546 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784711 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.784802 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785068 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785162 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785360 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785469 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785666 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785901 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.785992 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786224 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786326 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786560 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786656 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786882 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.786978 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787198 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787298 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787506 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787596 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787828 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.787926 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.788138 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.788236 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.788455 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.788681 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.788770 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789054 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789164 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789380 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789472 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789744 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.789845 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790033 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790131 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790351 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790442 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790662 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790760 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.790989 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.791097 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.791299 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.791396 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.791608 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.791928 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.792015 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.792249 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.792424 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.792592 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.792777 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.793481 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.793640 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.793832 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.793985 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.794131 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.794274 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.794421 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.794601 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.794860 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795007 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795154 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795310 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795481 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795642 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795789 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.795936 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796085 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796232 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796371 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796533 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796679 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.796823 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797035 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797186 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797324 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797485 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797627 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797783 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.797929 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798074 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798231 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798377 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798533 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798673 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798812 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.798812 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799076 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799201 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799325 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799445 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799563 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799690 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799820 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.799970 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800172 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800339 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800480 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800632 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800782 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.800920 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801108 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801203 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801275 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801530 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801631 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801854 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.801952 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802171 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802325 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802478 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802617 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802817 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.802964 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.803125 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.803258 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.803428 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.803739 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.803891 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.804332 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.804583 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.805294 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.805410 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.805537 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806107 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806402 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806532 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806708 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806807 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806891 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.806958 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.807025 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.807099 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.807589 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.807864 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.807959 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808051 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808134 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808134 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808299 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808405 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.808622 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809067 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809211 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809342 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809486 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809578 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809715 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809859 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.809947 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.810315 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.810472 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.810618 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.810710 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.810800 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811189 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811543 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811640 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811722 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811803 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.811933 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.812019 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.812239 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.812331 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.812834 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.812951 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813051 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813151 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813549 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813655 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813747 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813837 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.813969 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814075 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814508 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814618 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814703 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814826 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.814911 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815002 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815085 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815153 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815232 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815311 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815399 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815490 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815864 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.815973 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.816167 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.816259 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.816259 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.817723 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.817797 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.817872 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.817961 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818044 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818138 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818221 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818303 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818384 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818474 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818565 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818647 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818730 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818812 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818886 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.818974 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819069 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819151 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819223 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819303 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819377 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819377 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819538 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819634 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819704 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819779 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819846 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.819973 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820135 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820282 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820377 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820591 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820691 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.820908 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821039 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821257 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821374 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821570 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821660 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.821968 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822184 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822319 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822500 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822616 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822806 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.822924 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823114 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823258 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823439 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823612 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823728 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.823866 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.824567 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.824701 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.824874 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825244 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825394 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825573 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825710 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.825869 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826028 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826174 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826362 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826479 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826754 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.826846 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827127 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827229 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827397 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827552 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827702 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.827808 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828009 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828110 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828316 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828405 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828652 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828752 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.828960 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829069 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829319 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829561 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829649 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829745 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.829941 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830072 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830245 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830335 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830631 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830742 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830862 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.830952 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831186 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831292 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831492 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831582 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831804 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.831894 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832114 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832210 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832469 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832579 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832754 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.832844 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833102 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833278 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833514 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833737 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.833947 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834042 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834171 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834368 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834524 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834700 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.834875 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835004 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835231 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835373 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835574 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835691 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.835969 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836078 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836360 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836492 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836577 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836658 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836872 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.836971 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.837214 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.837314 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.837532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.837719 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.837843 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838002 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838520 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838605 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838698 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838838 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.838968 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.839059 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.839282 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.839372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.839629 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.840287 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.840486 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.840622 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.840820 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.840969 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841168 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841320 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841490 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841638 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841826 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.841967 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842146 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842298 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842465 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842651 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842783 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.842968 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843101 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843315 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843405 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843646 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843733 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.843963 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844058 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844279 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844367 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844587 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844684 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.844832 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105535) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:20:11.844930 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.845314 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.845649 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.845968 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.846300 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.846634 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.846993 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.847317 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.847670 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.848003 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.848323 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.848649 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.848986 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:20:11.849256 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105534) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:20:12.000755 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO dbcounter [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Registered counter for database nova_api Nov 02 12:20:12.004726 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Registered counter for database nova_api Nov 02 12:20:12.028609 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_db.sqlalchemy.engines [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.030299 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.035929 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writer thread running {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.037133 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.094453 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.context [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f9cbd8b-c305-4366-bd03-4bc429eae6e9(cell1) {{(pid=105535) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:20:12.094809 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.context [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f9cbd8b-c305-4366-bd03-4bc429eae6e9(cell1) {{(pid=105534) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:20:12.098627 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.098801 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.099103 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.099199 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.100749 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.100913 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.101505 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.101673 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:20:12.101947 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.102117 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:20:12.103987 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_concurrency.lockutils [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105535) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.104248 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:20:12.106095 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO dbcounter [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Registered counter for database nova_cell0 Nov 02 12:20:12.106386 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Registered counter for database nova_cell0 Nov 02 12:20:12.110510 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Registered counter for database nova_cell1 Nov 02 12:20:12.110654 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO dbcounter [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Registered counter for database nova_cell1 Nov 02 12:20:12.118232 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_db.sqlalchemy.engines [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.119819 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.121613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.124524 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writer thread running {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.127074 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.265771 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_db.sqlalchemy.engines [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.271329 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writer thread running {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.271953 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.280373 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO dbcounter [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Registered counter for database nova_cell0 Nov 02 12:20:12.282078 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO dbcounter [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Registered counter for database nova_cell0 Nov 02 12:20:12.287831 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG oslo_db.sqlalchemy.engines [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105535) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.291544 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_db.sqlalchemy.engines [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105534) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:20:12.294472 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writer thread running {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.296449 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writer thread running {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:20:12.641131 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:20:12.649420 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:20:12.652242 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: WARNING keystonemiddleware.auth_token [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:20:12.660047 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: WARNING keystonemiddleware.auth_token [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:20:12.998251 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:20:13.004263 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: WARNING keystonemiddleware.auth_token [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:20:13.009632 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a772be9c0 pid: 105534 (default app) Nov 02 12:20:13.011800 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:20:13.013279 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] 10.222.0.85 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002102 Nov 02 12:20:13.013447 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: WARNING keystonemiddleware.auth_token [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:20:13.013775 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 1/1] 10.222.0.85 () {50 vars in 788 bytes} [Wed Nov 2 12:20:13 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:20:13.019722 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: WARNING keystonemiddleware.auth_token [None req-d9304b20-61b3-47b7-923e-736fc45abe0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:20:13.025089 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a772be9c0 pid: 105535 (default app) Nov 02 12:21:40.119762 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:40.120669 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001996 Nov 02 12:21:40.121086 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 2/2] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:40.134751 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_api:SELECT=3 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:40.135698 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_cell0:SELECT=3 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:40.136909 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_cell1:SELECT=3 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:40.139384 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:41.065174 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-61bd3d2a-d689-4753-9005-6157a21f6d13 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:41.100316 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-61bd3d2a-d689-4753-9005-6157a21f6d13 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.971709 Nov 02 12:21:41.101357 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 1/3] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Nov 2 12:21:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:43.766613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:43.767602 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-5210befb-1ae8-42bf-9352-f7aef8289bd6 None None] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001598 Nov 02 12:21:43.768123 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 3/4] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:44.242935 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-4b471d11-1ff6-4dbc-a90a-7f961adbb907 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "ram": 256, "swap": 0, "disk": 1, "name": "cirros256", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:44.293734 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-4b471d11-1ff6-4dbc-a90a-7f961adbb907 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.518413 Nov 02 12:21:44.294529 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 2/5] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:21:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:21:44.309788 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:44.310651 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell1:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:44.312663 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell0:SELECT=3 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:44.313502 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:21:44.521809 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-88c78f6b-ac16-4331-a5c8-b11e6c79bcce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:44.592779 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-88c78f6b-ac16-4331-a5c8-b11e6c79bcce admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289407 Nov 02 12:21:44.593241 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 4/6] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Nov 2 12:21:44 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:47.263248 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-4b471d11-1ff6-4dbc-a90a-7f961adbb907 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:47.264263 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-4b471d11-1ff6-4dbc-a90a-7f961adbb907 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001731 Nov 02 12:21:47.264679 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 3/7] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:48.011161 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-14cf76cd-29e3-4d9e-a1cd-26ac2f33f8d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "swap": 0, "rxtx_factor": 1.0, "disk": 5}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:48.057248 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-14cf76cd-29e3-4d9e-a1cd-26ac2f33f8d5 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.786068 Nov 02 12:21:48.058626 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 5/8] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:21:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:48.070644 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-9c4d1a59-e060-48fb-9005-054d8ea09603 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:48.116506 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-9c4d1a59-e060-48fb-9005-054d8ea09603 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.049430 Nov 02 12:21:48.117500 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 4/9] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Nov 2 12:21:48 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:21:50.758176 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-14cf76cd-29e3-4d9e-a1cd-26ac2f33f8d5 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:50.759236 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-14cf76cd-29e3-4d9e-a1cd-26ac2f33f8d5 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Nov 02 12:21:50.759659 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 6/10] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:51.263725 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da2ca892-89b4-4a2e-aa92-057a0bafc4ef admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:51.287486 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da2ca892-89b4-4a2e-aa92-057a0bafc4ef admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.520660 Nov 02 12:21:51.288578 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 5/11] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:21:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:51.300354 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-c15c2aa3-9db1-4f11-b1bd-e42e102aa2bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:51.332148 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-c15c2aa3-9db1-4f11-b1bd-e42e102aa2bc admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035199 Nov 02 12:21:51.332833 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 7/12] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Nov 2 12:21:51 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:54.005823 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da2ca892-89b4-4a2e-aa92-057a0bafc4ef admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:54.006778 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da2ca892-89b4-4a2e-aa92-057a0bafc4ef admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Nov 02 12:21:54.007251 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 6/13] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:21:54.450822 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-43523460-bde7-4efc-b8e5-566694969462 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "name": "ds2G", "id": "d3", "ram": 2048, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:54.478773 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-43523460-bde7-4efc-b8e5-566694969462 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.464137 Nov 02 12:21:54.481039 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 8/14] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:21:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:54.491529 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-87c9b7de-2636-4f02-be81-03667be4f590 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:54.528681 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-87c9b7de-2636-4f02-be81-03667be4f590 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040442 Nov 02 12:21:54.530673 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 7/15] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Nov 2 12:21:54 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:21:57.297488 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-43523460-bde7-4efc-b8e5-566694969462 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:21:57.298773 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-43523460-bde7-4efc-b8e5-566694969462 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001861 Nov 02 12:21:57.299262 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 9/16] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:21:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:21:57.790596 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "ram": 4096, "disk": 20, "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:57.809496 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.502147 Nov 02 12:21:57.810077 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 8/17] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:21:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:21:57.822115 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-1bae9a4b-010d-4f0a-9b08-de5073f3d7c2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:21:57.848920 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-1bae9a4b-010d-4f0a-9b08-de5073f3d7c2 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030407 Nov 02 12:21:57.849532 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 10/18] 10.222.0.85 () {64 vars in 1336 bytes} [Wed Nov 2 12:21:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:00.987401 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:00.988614 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001722 Nov 02 12:22:00.989134 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 9/19] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:01.446383 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-fed15436-f2a7-4e8d-b77a-c3daae03c912 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:01.471603 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-fed15436-f2a7-4e8d-b77a-c3daae03c912 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.474605 Nov 02 12:22:01.472151 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 11/20] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Nov 2 12:22:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:04.370589 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:04.371600 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-3f5475d3-5b50-4320-b1c9-5c897ef1a1de admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Nov 02 12:22:04.372047 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 10/21] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:04.794625 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-301e5260-ba8e-4f72-a093-92a051b37852 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:04.816672 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-301e5260-ba8e-4f72-a093-92a051b37852 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.438131 Nov 02 12:22:04.817257 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 12/22] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:22:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:04.829159 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-f1c67ab4-3054-4c8f-809b-2d6ce6376c8d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:04.857825 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-f1c67ab4-3054-4c8f-809b-2d6ce6376c8d admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032275 Nov 02 12:22:04.858396 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 11/23] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Nov 2 12:22:04 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:07.517087 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-301e5260-ba8e-4f72-a093-92a051b37852 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:07.518691 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-301e5260-ba8e-4f72-a093-92a051b37852 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002075 Nov 02 12:22:07.519286 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 13/24] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:08.080573 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-f9f64507-905d-40f4-8b02-f6b9358e4d42 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "name": "m1.small", "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 2048}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:08.106589 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-f9f64507-905d-40f4-8b02-f6b9358e4d42 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.579966 Nov 02 12:22:08.107509 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 12/25] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:22:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:22:08.120311 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-670c7b01-4648-45da-bef4-455f7370813b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:08.146405 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-670c7b01-4648-45da-bef4-455f7370813b admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030144 Nov 02 12:22:08.146998 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 14/26] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Nov 2 12:22:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:22:10.840808 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-f9f64507-905d-40f4-8b02-f6b9358e4d42 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:10.844011 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-f9f64507-905d-40f4-8b02-f6b9358e4d42 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Nov 02 12:22:10.845087 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 13/27] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:11.304207 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-95cd01c5-b7de-4caa-9e70-3e4fb5a42109 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "disk": 40}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:11.328250 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-95cd01c5-b7de-4caa-9e70-3e4fb5a42109 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.476153 Nov 02 12:22:11.329121 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 15/28] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:22:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:11.343100 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-71caf6b5-0a7e-4b6c-ad85-15c77296a538 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:11.348209 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:11.374990 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-71caf6b5-0a7e-4b6c-ad85-15c77296a538 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035508 Nov 02 12:22:11.375982 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 14/29] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Nov 2 12:22:11 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:14.049857 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-95cd01c5-b7de-4caa-9e70-3e4fb5a42109 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:14.050778 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-95cd01c5-b7de-4caa-9e70-3e4fb5a42109 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Nov 02 12:22:14.051347 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 16/30] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:14.507234 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-ae1ab002-bc73-40ce-94cd-61d222a4f812 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 4, "id": "4", "swap": 0, "rxtx_factor": 1.0, "disk": 80, "name": "m1.large", "ram": 8192}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:14.528181 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-ae1ab002-bc73-40ce-94cd-61d222a4f812 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470472 Nov 02 12:22:14.528723 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 15/31] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:22:14 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:22:14.544957 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-b07e01fc-c89c-4d72-b972-68bc8aaf9132 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:14.572315 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-b07e01fc-c89c-4d72-b972-68bc8aaf9132 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034982 Nov 02 12:22:14.576243 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 17/32] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Nov 2 12:22:14 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:17.296434 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-ae1ab002-bc73-40ce-94cd-61d222a4f812 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:17.298195 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-ae1ab002-bc73-40ce-94cd-61d222a4f812 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002284 Nov 02 12:22:17.298846 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 16/33] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:17.752104 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 160, "vcpus": 8, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:17.759541 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:17.778700 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.474001 Nov 02 12:22:17.779571 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 18/34] 10.222.0.85 () {64 vars in 1283 bytes} [Wed Nov 2 12:22:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:17.793417 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-e4e1400a-e08f-40c9-8050-632d24823afd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:17.830747 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-e4e1400a-e08f-40c9-8050-632d24823afd admin admin] 10.222.0.85 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041835 Nov 02 12:22:17.831470 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 17/35] 10.222.0.85 () {64 vars in 1333 bytes} [Wed Nov 2 12:22:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:22:34.212143 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.213279 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Nov 02 12:22:34.213596 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 19/36] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:34.224202 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:22:34.622378 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-cd4b5830-34ab-4a34-b63f-0f705168b102 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:34.642469 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-cd4b5830-34ab-4a34-b63f-0f705168b102 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.422588 Nov 02 12:22:34.643050 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 18/37] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Nov 2 12:22:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:35.982219 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:35.983225 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-11fa23d1-4766-4df1-83b2-4922086ae431 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Nov 02 12:22:35.983632 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 20/38] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:36.525859 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-deb70881-5451-47c3-b916-c1a502b11f72 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.531465 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.wsgi [None req-deb70881-5451-47c3-b916-c1a502b11f72 admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-deb70881-5451-47c3-b916-c1a502b11f72 admin admin] Request method failure captured: Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept: application/json Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept-Encoding: gzip, deflate Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Connection: keep-alive Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Content-Length: 0 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Host: 10.222.0.85 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-System-Scope: None Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: User-Agent: python-novaclient Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Auth-Token: gAAAAABjYmELMXtHNUDq8WUPRc-SemAn8wkbX2Ocfz6cBFelTfL0P6hJJciB5NsyZtSSLoW5oPNMOT_KNlHzKrHfeKAO74KjLDKZR-qYSklFhgrr2VNVBLtlaCLKBNQki8vo7oa51aHISfFpaM0DJf-v8r9D-QbsQWXul9gEb2KR0yY-MXwuh2s Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Id: None Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Name: None Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Identity-Status: Confirmed Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Is-Admin-Project: True Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Id: default Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Name: Default Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Name: admin Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Role: admin,member,reader Nov 02 12:22:36.534877 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Roles: admin,member,reader Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant: admin Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Name: admin Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User: admin Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Id: default Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Name: Default Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Name: admin Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: method: > Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: exception: Flavor 42 could not be found. Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: action_args: {'id': '42'} Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:36.536532 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:36.537960 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.539813 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-deb70881-5451-47c3-b916-c1a502b11f72 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:36.541086 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-deb70881-5451-47c3-b916-c1a502b11f72 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.400158 Nov 02 12:22:36.541086 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Nov 2 12:22:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:36.546755 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-5e327a89-3bc2-4647-b480-b47ca9e23a22 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.570666 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-5e327a89-3bc2-4647-b480-b47ca9e23a22 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027459 Nov 02 12:22:36.571263 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:36.582203 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-026fc4db-e246-40b8-9079-e8d26b577f18 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.605263 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-026fc4db-e246-40b8-9079-e8d26b577f18 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027640 Nov 02 12:22:36.605825 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 20/41] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:36.616246 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-e9293871-d032-42da-807a-eef0160ecdff admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:36.622106 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-e9293871-d032-42da-807a-eef0160ecdff admin admin] HTTP exception thrown: Flavor 42 could not be found. Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-e9293871-d032-42da-807a-eef0160ecdff admin admin] Request method failure captured: Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept: application/json Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Connection: keep-alive Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Content-Length: 0 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Host: 10.222.0.85 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjYmELMXtHNUDq8WUPRc-SemAn8wkbX2Ocfz6cBFelTfL0P6hJJciB5NsyZtSSLoW5oPNMOT_KNlHzKrHfeKAO74KjLDKZR-qYSklFhgrr2VNVBLtlaCLKBNQki8vo7oa51aHISfFpaM0DJf-v8r9D-QbsQWXul9gEb2KR0yY-MXwuh2s Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Nov 02 12:22:36.625378 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant: admin Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User: admin Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Name: admin Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: method: > Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: exception: Flavor 42 could not be found. Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: action_args: {'id': '42'} Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:36.626722 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:36.628540 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:36.630030 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-e9293871-d032-42da-807a-eef0160ecdff admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:36.631350 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-e9293871-d032-42da-807a-eef0160ecdff admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.015133 Nov 02 12:22:36.631350 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 22/42] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Nov 2 12:22:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:37.877465 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-026fc4db-e246-40b8-9079-e8d26b577f18 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:37.878966 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-026fc4db-e246-40b8-9079-e8d26b577f18 admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001968 Nov 02 12:22:37.879494 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 21/43] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:38.419757 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-b53cba07-72c5-42c0-b9aa-866e88f2c353 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.424943 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-b53cba07-72c5-42c0-b9aa-866e88f2c353 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-b53cba07-72c5-42c0-b9aa-866e88f2c353 admin admin] Request method failure captured: Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept: application/json Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Connection: keep-alive Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Content-Length: 0 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Host: 10.222.0.85 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjYmENGY7dz12eQUhO3Ai0p76arfb7kwZ33xRVa13RTOiqoC3Wh_8gjgDp3Mogv2htOUrucTGGvzugYBNfxY_4LpwzivrYlxypJ90TrVdXvvPPuv4URZP_D22W6_APb5OfJPQ-wbU796i3Rb-rHOtKy0kBpf_J6-kJXBpQ-htRsHkqaCs Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Nov 02 12:22:38.426484 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant: admin Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User: admin Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Name: admin Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: method: > Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: exception: Flavor 84 could not be found. Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: action_args: {'id': '84'} Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:38.427989 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:38.428954 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.430343 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-b53cba07-72c5-42c0-b9aa-866e88f2c353 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:38.431458 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-b53cba07-72c5-42c0-b9aa-866e88f2c353 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.409296 Nov 02 12:22:38.431458 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 23/44] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 410 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:38.437696 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-4dca2467-d5dd-447f-ae33-f96df8a1d1b3 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.452905 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-4dca2467-d5dd-447f-ae33-f96df8a1d1b3 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018684 Nov 02 12:22:38.453495 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 22/45] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:22:38.463634 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-bc1ad4bd-0c2f-4a13-a732-8e8a820c933c admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.479789 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-bc1ad4bd-0c2f-4a13-a732-8e8a820c933c admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020214 Nov 02 12:22:38.480349 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:38.489726 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-c483ac02-38b3-452e-8911-81e31d4da613 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:38.494918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.wsgi [None req-c483ac02-38b3-452e-8911-81e31d4da613 admin admin] HTTP exception thrown: Flavor 84 could not be found. Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-c483ac02-38b3-452e-8911-81e31d4da613 admin admin] Request method failure captured: Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept: application/json Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept-Encoding: gzip, deflate Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Connection: keep-alive Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Content-Length: 0 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Host: 10.222.0.85 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-System-Scope: None Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: User-Agent: python-novaclient Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Auth-Token: gAAAAABjYmENGY7dz12eQUhO3Ai0p76arfb7kwZ33xRVa13RTOiqoC3Wh_8gjgDp3Mogv2htOUrucTGGvzugYBNfxY_4LpwzivrYlxypJ90TrVdXvvPPuv4URZP_D22W6_APb5OfJPQ-wbU796i3Rb-rHOtKy0kBpf_J6-kJXBpQ-htRsHkqaCs Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Id: None Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Name: None Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Identity-Status: Confirmed Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Is-Admin-Project: True Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Id: default Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Name: Default Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Name: admin Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Role: admin,member,reader Nov 02 12:22:38.496422 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Roles: admin,member,reader Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant: admin Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Name: admin Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User: admin Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Id: default Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Name: Default Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Name: admin Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: method: > Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: exception: Flavor 84 could not be found. Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: action_args: {'id': '84'} Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:38.498146 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:38.499372 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:38.500706 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-c483ac02-38b3-452e-8911-81e31d4da613 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:38.501979 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-c483ac02-38b3-452e-8911-81e31d4da613 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011620 Nov 02 12:22:38.501979 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 23/47] 10.222.0.85 () {60 vars in 1190 bytes} [Wed Nov 2 12:22:38 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Nov 02 12:22:39.729578 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-bc1ad4bd-0c2f-4a13-a732-8e8a820c933c admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:39.730861 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-bc1ad4bd-0c2f-4a13-a732-8e8a820c933c admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001828 Nov 02 12:22:39.731313 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 25/48] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:40.269452 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-773ea741-c3a7-4ba1-b498-3945a41cf344 admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:40.275873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.wsgi [None req-773ea741-c3a7-4ba1-b498-3945a41cf344 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-773ea741-c3a7-4ba1-b498-3945a41cf344 admin admin] Request method failure captured: Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept: application/json Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Accept-Encoding: gzip, deflate Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Connection: keep-alive Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Content-Length: 0 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Host: 10.222.0.85 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Openstack-System-Scope: None Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: User-Agent: python-novaclient Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Auth-Token: gAAAAABjYmEPGCHCOMm6v3cZbeyOC5dP6SW_Bq0fPPLM_yG5e0alu1TrHr7du5Oj647EWf0yXhoE-JSmEpA5ClrLX3CclCPX8o_qBNzAGCBgGetDM64XrjWLgHuUgjhPzyDb7Ashadv333yERJF4iHn3hae7r_tqQ6MQkC7df4XYL_d0Hm7LC4Q Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Id: None Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Domain-Name: None Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Identity-Status: Confirmed Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Is-Admin-Project: True Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Id: default Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Domain-Name: Default Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Project-Name: admin Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Role: admin,member,reader Nov 02 12:22:40.277414 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Roles: admin,member,reader Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant: admin Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-Tenant-Name: admin Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User: admin Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Id: default Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Domain-Name: Default Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: X-User-Name: admin Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: method: > Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: exception: Flavor 451 could not be found. Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: action_args: {'id': '451'} Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:40.278980 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:40.279873 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.280918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-773ea741-c3a7-4ba1-b498-3945a41cf344 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105535) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:40.281959 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-773ea741-c3a7-4ba1-b498-3945a41cf344 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.410090 Nov 02 12:22:40.281959 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:22:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:40.288599 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-127b9632-269d-4fcb-b2a9-5d3dbbd8f2a9 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:40.303940 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-127b9632-269d-4fcb-b2a9-5d3dbbd8f2a9 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018931 Nov 02 12:22:40.304559 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 26/50] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:40.314125 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:40.329375 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018816 Nov 02 12:22:40.329918 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 25/51] 10.222.0.85 () {60 vars in 1210 bytes} [Wed Nov 2 12:22:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:22:40.339918 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f36ffa56-9abf-4f14-ac16-851d7bd7bec0 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:40.345024 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.wsgi [None req-f36ffa56-9abf-4f14-ac16-851d7bd7bec0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f36ffa56-9abf-4f14-ac16-851d7bd7bec0 admin admin] Request method failure captured: Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept: application/json Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Accept-Encoding: gzip, deflate Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Connection: keep-alive Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Content-Length: 0 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Host: 10.222.0.85 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-Api-Version: compute 2.92 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Openstack-System-Scope: None Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: User-Agent: python-novaclient Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Auth-Token: gAAAAABjYmEPGCHCOMm6v3cZbeyOC5dP6SW_Bq0fPPLM_yG5e0alu1TrHr7du5Oj647EWf0yXhoE-JSmEpA5ClrLX3CclCPX8o_qBNzAGCBgGetDM64XrjWLgHuUgjhPzyDb7Ashadv333yERJF4iHn3hae7r_tqQ6MQkC7df4XYL_d0Hm7LC4Q Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Id: None Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Domain-Name: None Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Identity-Status: Confirmed Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Is-Admin-Project: True Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Openstack-Nova-Api-Version: 2.92 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Id: default Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Domain-Name: Default Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Project-Name: admin Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Role: admin,member,reader Nov 02 12:22:40.346624 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Roles: admin,member,reader Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bbb8bdae345348eca7be88e01d7954f8"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant: admin Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Id: bbb8bdae345348eca7be88e01d7954f8 Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-Tenant-Name: admin Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User: admin Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Id: default Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Domain-Name: Default Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Id: 16d94c9123ce4b32b47b3b412b38ab1b Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: X-User-Name: admin Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: method: > Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: exception: Flavor 451 could not be found. Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: action_args: {'id': '451'} Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:22:40.348276 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:40.349272 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: ERROR nova.api.openstack.wsgi Nov 02 12:22:40.350613 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f36ffa56-9abf-4f14-ac16-851d7bd7bec0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105534) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:22:40.351867 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-f36ffa56-9abf-4f14-ac16-851d7bd7bec0 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012299 Nov 02 12:22:40.351867 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 27/52] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:22:40 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Nov 02 12:22:41.600895 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:41.601956 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Nov 02 12:22:41.602534 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 26/53] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:42.144235 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-06912b34-8e01-4674-ba63-5e1c01e91cb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:42.163595 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-06912b34-8e01-4674-ba63-5e1c01e91cb4 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.418779 Nov 02 12:22:42.164337 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 28/54] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Nov 2 12:22:41 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:43.400774 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:43.401885 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Nov 02 12:22:43.402286 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 27/55] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:43.946475 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-449fcf5a-ecca-4774-bdf5-5fbc9d646798 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:43.964951 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-449fcf5a-ecca-4774-bdf5-5fbc9d646798 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.424042 Nov 02 12:22:43.965535 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 29/56] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Nov 2 12:22:43 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:45.217417 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:45.218429 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Nov 02 12:22:45.218828 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 28/57] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:45.743702 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-c761f372-37ad-4949-9a3a-61ec368ba604 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:45.763631 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-c761f372-37ad-4949-9a3a-61ec368ba604 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.407176 Nov 02 12:22:45.764185 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 30/58] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Nov 2 12:22:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:47.007272 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:47.008280 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001556 Nov 02 12:22:47.008683 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 29/59] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:22:47.573113 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-eaa8015a-8369-414e-a232-10c08bd65973 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:22:47.593056 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-eaa8015a-8369-414e-a232-10c08bd65973 admin admin] 10.222.0.85 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.445085 Nov 02 12:22:47.593616 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 31/60] 10.222.0.85 () {64 vars in 1235 bytes} [Wed Nov 2 12:22:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:22:48.830184 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:48.831192 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Nov 02 12:22:48.831597 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 30/61] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:22:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:22:49.365306 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f2ee1117-03d7-4350-8823-06d304ceec82 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:22:49.386980 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-f2ee1117-03d7-4350-8823-06d304ceec82 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.416582 Nov 02 12:22:49.387789 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 32/62] 10.222.0.85 () {60 vars in 1202 bytes} [Wed Nov 2 12:22:48 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:40.527431 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.528482 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-da337c58-b1fd-43e7-ae83-8e73fbedf68a admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Nov 02 12:23:40.528890 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 31/63] 10.222.0.85 () {54 vars in 931 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:23:40.539982 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:40.937854 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-f75641e3-c1f3-41af-ba4b-295e4bd43b15 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.959004 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-f75641e3-c1f3-41af-ba4b-295e4bd43b15 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.424041 Nov 02 12:23:40.959545 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 33/64] 10.222.0.85 () {60 vars in 1292 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:23:40.980592 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_api:SELECT=14 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:23:40.984772 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-a2e493b9-31da-482e-a308-3c9ef571364e admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:40.992070 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-a2e493b9-31da-482e-a308-3c9ef571364e admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013007 Nov 02 12:23:40.992588 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 32/65] 10.222.0.85 () {60 vars in 1283 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:41.004313 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-b1a31f6e-6af1-4626-9577-111447fc3431 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.012470 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-b1a31f6e-6af1-4626-9577-111447fc3431 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011556 Nov 02 12:23:41.013018 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 34/66] 10.222.0.85 () {60 vars in 1286 bytes} [Wed Nov 2 12:23:40 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:41.025208 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.032574 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010846 Nov 02 12:23:41.033069 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 33/67] 10.222.0.85 () {60 vars in 1286 bytes} [Wed Nov 2 12:23:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:23:41.044936 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-6c8ae887-240d-4e87-bcd6-daf7cfde7030 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:23:41.052349 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-6c8ae887-240d-4e87-bcd6-daf7cfde7030 admin admin] 10.222.0.85 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011014 Nov 02 12:23:41.052890 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 35/68] 10.222.0.85 () {60 vars in 1283 bytes} [Wed Nov 2 12:23:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:26:50.886164 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:50.887171 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 Nov 02 12:26:50.887567 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 34/69] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:51.027375 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=6 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:26:51.184674 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:51.189409 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:51.189873 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:51.190789 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:51.191496 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:51.191933 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:51.192338 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:51.232919 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-cd947eb6-2e27-4df2-81d4-6eb60d82f7d2 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.206706 Nov 02 12:26:51.233508 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 36/70] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:26:51 2022] GET /compute/v2.1/os-services => generated 791 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:26:52.319148 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:52.320239 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Nov 02 12:26:52.320660 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 35/71] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:26:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:26:52.516574 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:26:52.520567 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.521065 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.521496 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.522221 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:26:52.522667 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:26:52.523081 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:26:52.543568 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-11b28099-34ee-4ebc-b644-6ae139f15f71 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.083097 Nov 02 12:26:52.544031 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 37/72] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:26:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:27:04.016935 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.017996 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001460 Nov 02 12:27:04.018433 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 36/73] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:04.159706 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell0:SELECT=4 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:04.160469 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_cell1:SELECT=4 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:04.161108 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG dbcounter [-] [105534] Writing DB stats nova_api:SELECT=8 {{(pid=105534) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:27:04.210687 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:04.214077 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.214549 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.214968 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.215704 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:04.216140 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:04.216548 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:04.242170 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-57dbc8ef-0c8a-4eef-9770-5a774f2834ac admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087312 Nov 02 12:27:04.242646 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 38/74] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:27:04 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:27:05.317474 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG nova.api.openstack.wsgi [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] Calling method '>' {{(pid=105535) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.318535 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: INFO nova.api.openstack.requestlog [None req-04d12b6b-f4e4-4e44-9c00-5e746c380aac admin admin] 10.222.0.85 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Nov 02 12:27:05.318950 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: [pid: 105535|app: 0|req: 37/75] 10.222.0.85 () {56 vars in 1074 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:27:05.518819 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG nova.api.openstack.wsgi [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Calling method '>' {{(pid=105534) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:27:05.522293 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.522703 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.523122 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.523856 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:27:05.524293 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:27:05.524696 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: DEBUG oslo_concurrency.lockutils [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105534) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:27:05.546333 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: INFO nova.api.openstack.requestlog [None req-5f97191e-9c82-4a23-83f0-3c1539912fe3 admin admin] 10.222.0.85 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079489 Nov 02 12:27:05.546882 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: [pid: 105534|app: 0|req: 39/76] 10.222.0.85 () {60 vars in 1193 bytes} [Wed Nov 2 12:27:05 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:28:04.303636 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: Wed Nov 2 12:28:04 2022 - graceful shutdown triggered... Nov 02 12:28:04.304370 dv-cinder-863273-1-iscsi devstack@n-api.service[105534]: Gracefully killing worker 1 (pid: 105534)... Nov 02 12:28:04.303684 dv-cinder-863273-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Nov 02 12:28:04.305492 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: Gracefully killing worker 2 (pid: 105535)... Nov 02 12:28:04.436080 dv-cinder-863273-1-iscsi devstack@n-api.service[105535]: DEBUG dbcounter [-] [105535] Writing DB stats nova_api:SELECT=4 {{(pid=105535) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:05.304809 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: worker 1 buried after 1 seconds Nov 02 12:28:05.304809 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: worker 2 buried after 1 seconds Nov 02 12:28:05.304809 dv-cinder-863273-1-iscsi devstack@n-api.service[105533]: goodbye to uWSGI. Nov 02 12:28:05.306783 dv-cinder-863273-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Nov 02 12:28:05.307740 dv-cinder-863273-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Nov 02 12:28:05.311342 dv-cinder-863273-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Nov 02 12:28:05.325817 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Nov 2 12:28:05 2022] *** Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: nodename: dv-cinder-863273-1-iscsi Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: machine: x86_64 Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: clock source: unix Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: pcre jit disabled Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: detected number of CPU cores: 4 Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: current working directory: / Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: detected binary path: /usr/bin/uwsgi-core Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: your processes number limit is 47680 Nov 02 12:28:05.329123 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: your memory page size is 4096 bytes Nov 02 12:28:05.330105 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: detected max file descriptor number: 2048 Nov 02 12:28:05.330105 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: lock engine: pthread robust mutexes Nov 02 12:28:05.330105 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: thunder lock: enabled Nov 02 12:28:05.330105 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Nov 02 12:28:05.330105 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Nov 02 12:28:05.369925 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: Python main interpreter initialized at 0x56005211b9c0 Nov 02 12:28:05.369925 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: python threads support enabled Nov 02 12:28:05.369925 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: your server socket listen backlog is limited to 100 connections Nov 02 12:28:05.369925 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: your mercy for graceful operations on workers is 90 seconds Nov 02 12:28:05.370384 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: mapped 403077 bytes (393 KB) for 2 cores Nov 02 12:28:05.370384 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: *** Operational MODE: preforking *** Nov 02 12:28:05.370668 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: *** uWSGI is running in multiple interpreter mode *** Nov 02 12:28:05.370668 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: spawned uWSGI master process (pid: 120724) Nov 02 12:28:05.370908 dv-cinder-863273-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Nov 02 12:28:05.373797 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: spawned uWSGI worker 1 (pid: 120739, cores: 1) Nov 02 12:28:05.376030 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: spawned uWSGI worker 2 (pid: 120740, cores: 1) Nov 02 12:28:05.376030 dv-cinder-863273-1-iscsi devstack@n-api.service[120724]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Nov 02 12:28:06.068990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:28:06.080883 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Nov 02 12:28:07.304451 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:28:07.304451 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Nov 02 12:28:07.305833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:28:07.305833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: from cryptography.utils import int_from_bytes Nov 02 12:28:07.319329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:28:07.319329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Nov 02 12:28:07.320265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:28:07.320265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: from cryptography.utils import int_from_bytes Nov 02 12:28:09.878774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:28:09.879595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:28:09.879595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:28:09.880097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:28:09.880234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:28:09.880639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.880971 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.881330 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.881659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.882026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.882339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.882930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.883257 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.883592 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.883857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.884179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.884832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863273-1-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.885207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.885545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.885841 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.886170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.886501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.886812 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.887136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.887650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.890104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863273-1-iscsi {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.892504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.894836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.896982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.898517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.898517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.898517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.898517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.898517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.899563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.899563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.899563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.899563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.901583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.905722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.907465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.909239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.913111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.914703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.916844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.922270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.924040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.926804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.931447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.933065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.936517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.939014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.941333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.945401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.947191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.950463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.953395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.956099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.958433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.962287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.967543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.969181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.970813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.973393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.977475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.979291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.981137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.984766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.987001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.990628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.992596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.995124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:09.996861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.000474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.002255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.004689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.006545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.009316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.011071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.011071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.011071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.011071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.012000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.012000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.012000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.012853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.015101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.015453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.017519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.017519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.017519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.017519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.019423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.019423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.019423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.019423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.019423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.020605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.020605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.020605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.021372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.021372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.021835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.021835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.022294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.022518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.022765 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.023164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.023466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.023720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.024513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.024779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.025117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.025453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.025775 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.026087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.026412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.026753 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.027073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.027389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.027700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.028011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.028434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.028893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.028893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.029912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.029912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.029912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.031345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.031345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.031806 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.032075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.032309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.032559 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.032807 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.033367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.033685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.034250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.034570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.035200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.035200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.035686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.035945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.036179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.036477 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.036915 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.037263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.037571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.037878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.038300 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.038722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.039133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.039881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.039881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.040439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.040809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.041166 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.041493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.041812 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.042129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.042877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.042877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.043436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.043436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.044851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.044851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.044851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.044851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.046037 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.046037 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.046977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.047360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.047752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.048073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.048462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.048967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.049423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.049710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.050418 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.050418 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.050901 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.051143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.051433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.051730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.052059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.052389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.052706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.053199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.053502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.053828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.054148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.054815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.055066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.055467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.055713 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.055998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.056317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.056671 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.057114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.057497 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.057830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.058650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.058650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.059283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.059645 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.059645 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.060578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.060578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.060578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.061343 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.061804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.062117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.062386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.062620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.062848 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.063409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.063653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.063896 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.064118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.064425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.064979 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.065289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.065779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.066441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.066769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.067205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.067545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.067777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.068089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.068396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.068772 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.069117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.069618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.069990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.070270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.071022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.071022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.071485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.071707 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.071987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.072303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.072769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.073223 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.073519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.073853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.074170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.074499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.075324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.075324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.076005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.076005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.076507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.076755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.077047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.077333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.077795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.078133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.078446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.078785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.079115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.079434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.079864 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.080240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.080729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.080729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.081787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.081787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.081787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.082471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.082471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.082937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.083237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.083466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.083766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.084050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.084296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.084556 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.085046 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.085451 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.085741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.086019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.086394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.086647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.086906 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.087363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.087695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.088161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.088594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.088875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.089203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.089623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.090090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.090504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.090749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.091011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.091726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.091998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.092350 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.093389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.093641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.093875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.094203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.094527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.094988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.095511 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.095798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.096125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.096530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.096802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.097187 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.097539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.097870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.098213 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.098514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.098837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.102439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.102439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.102439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.102439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.102439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.103659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.103659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.103659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.103659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.104510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.104510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.104935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.104935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.105680 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.105927 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.106511 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.106917 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.107171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.107486 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.107817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.108140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.108499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.109412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.109729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.110168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.110602 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.110898 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.111315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.111875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.112328 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.112576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.112883 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.113253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.113863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.114220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.114550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.114885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.115217 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.115897 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.116205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.116466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.116689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.117129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.117385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.117669 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.118043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.118435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.118746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.119066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.119377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.119759 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.120081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.120421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.120857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.121134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.121716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.121716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.122698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.122698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.123124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.123124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.123585 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.123711 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.124139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.124454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.124777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.125167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.125488 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.125828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.126169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.126481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.126792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.127132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.127447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.127779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.128106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.128688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.128983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.129243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.129760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.130106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.130568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.130922 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.131258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.131574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.131884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.132203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.132852 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.133305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.133647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.133969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.134286 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.134657 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.134952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.135394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.135714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.136058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.136376 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.136691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.137030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.137353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.137666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.138104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.138472 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.138927 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.139197 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.139523 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.139880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.140196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.140514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.140832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.141179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.141501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.141844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.142160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.142478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.142921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.143248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.143574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.143904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.144222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.144552 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.144880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.145243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.145572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.145889 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.146374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.146887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.146887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.147209 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.147521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.147834 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.148142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.148463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.148788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.149196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.149432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.149743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.150058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.150368 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.150954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.151347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.151611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.151988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.152302 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.152652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.152919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.153453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.153665 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.153845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:28:10.153845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:28:10.154687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.154687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.155013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:28:10.155196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.155895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:28:10.156071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.156268 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:28:10.156440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.156440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.156767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.156949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.157173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.157366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.157567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.157892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.158072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.158261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.158449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.158622 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.158791 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.159045 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.159245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.159454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.159675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.159913 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.160103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.160103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.160369 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.160503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.160655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.160655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.161098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-863273-1-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.161235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.161395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.161746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.161883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.162034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.162166 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.162306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.162450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.169191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.169191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.169507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.169717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.169884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.169884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.170168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.170168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.170406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.170569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.170698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.170853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.171054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.171679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.171851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.171991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.172154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.172308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.172446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.172597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.172736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.172868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.173021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.173176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.173312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.173447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.173573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.173747 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.173872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.173872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-863273-1-iscsi {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.174091 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.174228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.174379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.174534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.174695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.174838 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.174991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.175138 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.175276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.175425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.175558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.175706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.175834 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.175965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.176103 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.176258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.176394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.176528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.176661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.176807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.176962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.177181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.177500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.177688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.177688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.177688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.177688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.177688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.179445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.179675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.179675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.179675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.179675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.180347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.180499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.180717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.180919 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.181184 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.181387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.181539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.181539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.181744 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.181744 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.181903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.181982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.182186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182273 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120740) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.182861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.183111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.183442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.184052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.85 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.184396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.85 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.184793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.185273 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.185677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.186100 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.186931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.187433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.188438 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.188640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.191489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.192193 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.192830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.193401 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.193845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.194299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.194733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.195175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.195605 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.196031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.196464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.196889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.197624 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.198172 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.199119 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.199234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.199660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.200087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.200462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.200840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.201270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.201745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.202262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.202674 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.203076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.203470 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.203898 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.204294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.204697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.205128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.205523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.205927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.206317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.206704 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.207104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.207613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.208326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.208605 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.209163 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.209634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.210099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.210551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.211007 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.211475 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.211947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.212434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.212880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.213364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.213795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.214218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.214690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.215123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.215551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.215980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.216410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.216847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:28:10.217342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.217785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.218761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.219272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.219753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.220197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.220628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.221107 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.221547 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.222057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.222494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.222926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.223357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.223847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.224274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.224829 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.225345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.225802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.226351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.226803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.227254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.227725 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.228181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.228724 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.229552 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.229887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.230396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.230913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.231664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.232147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.232649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.233169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.234204 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.234698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.235153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.235564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.235963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.236375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.236775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.237493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.237997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.238537 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.239087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.239709 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.240147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.240585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.240985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.241495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.241596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Registered counter for database nova_api Nov 02 12:28:10.242241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.243145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.244241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.244397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.244850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.245430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.245826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.246327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.246865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.247306 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.247839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.248332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.249150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.250010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.250244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.250676 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.251634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.252174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.252714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.253286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.253780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.254303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.254773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.255193 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.255684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.256148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.256883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.257232 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.257964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.258440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.258952 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.259510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.260003 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.261158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.261646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.262470 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.263082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.263840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.264270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.264855 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.266472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.266472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.266694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.267123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.267262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.267729 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.268275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.268847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.269591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.270012 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.274627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.276366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.276500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.277559 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.277929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.278527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.279217 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.279793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.280860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.281456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.282173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.282660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.283051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.283534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.283995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.284440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.284898 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.285374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.286106 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.286442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.286997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.287525 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.288076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.288597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.291699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.291699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.291699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.291699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.291699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.292560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.292560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.292929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.293435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.293995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.294517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.295067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.295589 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.296697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.297364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.297925 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.298460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.299290 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.302011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.302498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.303088 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.303726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.304214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.304768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.305506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.306092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.306647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.321975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.322722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.323257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.323988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.324635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.325473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.326072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.326765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.327679 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.328454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.329827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.330402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.330982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.331583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.332176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.332929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.333391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.333965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.334491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.335061 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.335651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.336221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.336779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.337362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.338079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.340071 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.340691 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.341418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.342049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.342660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.343807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.344483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.345954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.346706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.347426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.348061 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.348602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.349071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.context [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f9cbd8b-c305-4366-bd03-4bc429eae6e9(cell1) {{(pid=120740) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:28:10.349250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.350163 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.350752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.351429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.352052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.352853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.353630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.354173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.354658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.355315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.356224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.356593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.357420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.357839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.358018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.360429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.360644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.361770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.362689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.363011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Registered counter for database nova_cell0 Nov 02 12:28:10.363877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.365100 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.366100 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.367195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.368057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.368825 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Registered counter for database nova_cell1 Nov 02 12:28:10.369344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.370813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.372416 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.373407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.374805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.375932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.377899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.378564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.379529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.380869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.382085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.383284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.383554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.384599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.385332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.386251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.387308 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.388213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.389017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.389772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.391646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.392533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.393449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.394429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.395285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.396244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.397170 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.398087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.399032 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.400056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.401330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.402190 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.403074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.403910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.405848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.406796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.407688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.408578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.409478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.410427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.411690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.412579 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.413517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.414459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.415391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.416304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.417196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.417959 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.418780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.419629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.420486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.422297 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.423154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.424004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.424924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.425833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.426673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.427544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.428378 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.429262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.430115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.431038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.432330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.433241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.434103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.434938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.435897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.437359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.438241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.439154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.440029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.440888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.441796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.443104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.444151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.445076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.445949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.446777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.447598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.448404 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.449281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.450130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.450884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.451688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.452980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.453879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.454727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.455518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.456446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.457425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.458356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.459221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.460078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.461119 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.462219 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.465710 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.466777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.467670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.471838 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.472980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.474183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.475367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.476321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.477340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.478315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.479216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.480136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.481183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.482264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.484230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.485155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.486086 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.486940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.487788 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.488687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.489587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.490463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.491388 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.492264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.493160 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.494410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.495268 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.496116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.496924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.497809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.498653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.500945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.501948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.502716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.503578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.504743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.505781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.506806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.507937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.508912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.509873 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.510758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.511760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.512614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.513562 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.515353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.516358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.517253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.518205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.519148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.520813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.521861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.522781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.523752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.524883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.526005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.526956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.527901 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.528785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.529941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.530661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.531261 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.532132 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.532802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.533754 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.534931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.535821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.536583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.537271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.537950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.538631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.539285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.539932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.540640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.541581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.542151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.542910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.543590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.544242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.544940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.545800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.546993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.547887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.548487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.549228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.549702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.550244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.550798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.551361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.551944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.552546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.553204 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.554087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.559558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.559766 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.560490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.562403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.563754 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.565234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.566153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.567066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.567520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.567908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.568739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.569383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.570169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.571019 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.571786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.572571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.573185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.573775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.574406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.574972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.575548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.576355 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.577326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.578121 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.578699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.579290 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.579888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.580411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.580971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.581606 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.582115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.582651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.583329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.583828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.584351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.584904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.585584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.586193 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.586822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.587407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.588076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.588633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.589491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.590049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.590587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.591468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.592285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.593240 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.593856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.594524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.595181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.595930 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.596646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.597345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.597972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.598571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.599205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.599877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.600498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.601019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO dbcounter [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Registered counter for database nova_cell0 Nov 02 12:28:10.601737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.602440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.603095 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.603755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.605078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.605961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.606835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.607792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.609091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.609880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.610708 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.611533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.612341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.612514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_db.sqlalchemy.engines [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120740) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.613377 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.614347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.615183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.616077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.617143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.618008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writer thread running {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.618316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.619200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.620040 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.620938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.621936 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.622903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.623749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.625179 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.626015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.626887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.627745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.628573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.629442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.630389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.631257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.632069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.633126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.633816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.634319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.635431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.635520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.636113 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.636711 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.637390 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.638229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.639486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.640322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.641181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.641968 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.642755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.643573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.644541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.645507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.646373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.647170 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.648025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.648859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.649759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.650615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.651389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.651950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.652630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.653477 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.654779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.655836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.656700 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.657558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.660111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.661136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.661892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.662701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.663488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.664189 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.664915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.665516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.666210 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.666874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.667558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.668132 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.668826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.669521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.670328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.671533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.672330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.673075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.673724 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.674458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.675096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.675769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.676450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.677111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.677776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.678508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.679373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.679945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.680469 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.681360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.682165 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.682903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.684330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.685085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.685504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.686056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.686695 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.687746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.688307 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.688868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.691224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.691812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.692653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.693395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.694036 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.694953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.695686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.696233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.696866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.697615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.698383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.699120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.699910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.701527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.702879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.703538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.704092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.704798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.705416 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.706059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.706696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.707533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.708316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.709162 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.709721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.710306 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.710809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.711326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.711830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.712810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.712922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.713568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.714177 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.714574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.714981 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.715386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.715807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.716202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.716591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.717198 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.717680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.718647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.719051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.719443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.719856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.720334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.720864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.721357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.721787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.722292 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.722753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.723197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.723725 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.724200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.724597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.724982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.725422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.725821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.726212 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.726657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.727043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.727478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.727965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.728373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.728945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.729332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.729748 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.730131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.730588 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.731067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.731493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.731875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.732269 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.732656 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.733127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.733633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.734109 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.734658 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.735044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.735462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.735900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.736291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.736714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.737194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.737628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.738142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.738617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.739015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.739410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.739828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.740242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.740797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.741487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.741922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.742338 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.742757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.743155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.743567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.743970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.744399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.744856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.745321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.745759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.746181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.746641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.747092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.747517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.747949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.748462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.748895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.749915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.750344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.750806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.751383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.751903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.752340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.752792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.753272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.753809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.754306 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.755141 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.755718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.756194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.756683 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.757310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.758279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.758942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.759384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:28:10.759705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120739) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:28:10.834328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Registered counter for database nova_api Nov 02 12:28:10.860550 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.869145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.935544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.context [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3f9cbd8b-c305-4366-bd03-4bc429eae6e9(cell1) {{(pid=120739) load_cells /opt/stack/nova/nova/context.py:464}} Nov 02 12:28:10.939874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.940368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.942055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.942898 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:28:10.943378 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:28:10.945598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:28:10.947926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Registered counter for database nova_cell0 Nov 02 12:28:10.952769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Registered counter for database nova_cell1 Nov 02 12:28:10.962082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.964964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:10.970810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.977776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:10.988727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:28:10.997410 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:28:11.138591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO dbcounter [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Registered counter for database nova_cell0 Nov 02 12:28:11.148961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_db.sqlalchemy.engines [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120739) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:28:11.158380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writer thread running {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Nov 02 12:28:11.377751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:28:11.385794 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: WARNING keystonemiddleware.auth_token [None req-64c65793-73cf-4d81-afdf-0d3e8c4f6b17 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:28:11.393220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56005211b9c0 pid: 120740 (default app) Nov 02 12:28:11.523348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:28:11.531380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:28:11.907841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:28:11.914776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: WARNING keystonemiddleware.auth_token [None req-4b9aa7bf-01ef-4c40-acd7-1f545c41e8c3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:28:11.920299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56005211b9c0 pid: 120739 (default app) Nov 02 12:28:57.141106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:57.143331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:57.144817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:57.145951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:58.461422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:58.462900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:58.463629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:58.465161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:28:59.784204 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-10c2f561-1242-4ec2-b586-7dae98cc017d tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Action: 'create', calling method: .version_select at 0x7faf079893a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-29043286", "metadata": {"Type": "work"}}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:00.502449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ddc79ea8-2e14-49ac-9448-d5d50ed5baa1 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Action: 'create', calling method: .version_select at 0x7faf079873a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-104730594"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:02.377539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-10c2f561-1242-4ec2-b586-7dae98cc017d tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 351 microversion: 2.1 time: 5.270847 Nov 02 12:29:02.380629 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 1/1] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Nov 2 12:28:57 2022] POST /compute/v2.1/os-volumes => generated 351 bytes in 5277 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:29:02.391416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6aac6a14-c564-47ea-9bee-3b8414968aeb tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf07869280>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:02.742415 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6aac6a14-c564-47ea-9bee-3b8414968aeb tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/4e971fe5-353f-4ab2-9337-c7cd3c4bb043" status: 200 len: 350 microversion: 2.1 time: 0.359869 Nov 02 12:29:02.754288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 2/2] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/os-volumes/4e971fe5-353f-4ab2-9337-c7cd3c4bb043 => generated 350 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:02.765447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7fb428bd-3aff-4b10-ab43-3ac5b4c48eba tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Calling method '.version_select at 0x7faf078699d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:03.623594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7fb428bd-3aff-4b10-ab43-3ac5b4c48eba tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46" status: 200 len: 352 microversion: 2.1 time: 0.867408 Nov 02 12:29:03.624628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 3/3] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:02 2022] GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46 => generated 352 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:03.657997 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9741da2d-e98d-4029-9ef7-0041fa59b532 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Calling method '.version_select at 0x7faf078680d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.121376 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ddc79ea8-2e14-49ac-9448-d5d50ed5baa1 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 5.664888 Nov 02 12:29:04.123988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 1/4] 10.222.0.85 () {60 vars in 1155 bytes} [Wed Nov 2 12:28:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 5669 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Nov 02 12:29:04.158322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49e9fe55-90ac-45f0-8419-bf375b9aa330 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786b280>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.196435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9741da2d-e98d-4029-9ef7-0041fa59b532 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46" status: 200 len: 352 microversion: 2.1 time: 0.552016 Nov 02 12:29:04.197999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 4/5] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:03 2022] GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46 => generated 352 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:04.231873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-28cdb313-cec4-4b3b-ad5c-37d36a5f576a tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Calling method '.version_select at 0x7faf07869d30>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:04.419636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49e9fe55-90ac-45f0-8419-bf375b9aa330 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33" status: 200 len: 345 microversion: 2.1 time: 0.270043 Nov 02 12:29:04.435766 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 2/6] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 => generated 345 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:04.449187 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe139d56-4c74-41bc-b493-beb78b534d72 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Action: 'create', calling method: .version_select at 0x7faf0786b8b0>, body: {"snapshot": {"volume_id": "e692b4e3-9283-44ce-8645-1eb85f975a33", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-906001625"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:04.743782 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-28cdb313-cec4-4b3b-ad5c-37d36a5f576a tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46" status: 202 len: 0 microversion: 2.1 time: 0.517013 Nov 02 12:29:04.744935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 5/7] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:29:04 2022] DELETE /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:04.771125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-528c062f-d24d-4019-bf49-8070a61da688 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Calling method '.version_select at 0x7faf07869550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.555571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-528c062f-d24d-4019-bf49-8070a61da688 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] HTTP exception thrown: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-528c062f-d24d-4019-bf49-8070a61da688 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Request method failure captured: Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46 HTTP/1.1 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKIJJnTV5Vd73lRLyBdAEaRHKnqAhMHfiN4ftA0JIklKxR4oG-CYEnC4C17WiInXTF-sAvxXnqt8amsbp3--wcOruPpPuOMF87N1gaP1j8-SBbXk_ARdiJVAqVWq6MyDjyiUrO2fZo5D5Y52_-9O7bFi0qsb8C3Iog8ML1ujLLN0s8 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 2c34199e1871487882981bb6a96a6e15 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesGetTestJSON-2000774454 Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:05.566158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2c34199e1871487882981bb6a96a6e15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2c34199e1871487882981bb6a96a6e15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c34199e1871487882981bb6a96a6e15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2c34199e1871487882981bb6a96a6e15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesGetTestJSON-2000774454 Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2c34199e1871487882981bb6a96a6e15 Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesGetTestJSON-2000774454 Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesGetTestJSON-2000774454-project Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: beacd62576aa4df49b561bef591e665f Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesGetTestJSON-2000774454-project Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '24445965-345e-460e-a221-fb5b547b7f46'} Nov 02 12:29:05.568079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. (HTTP 404) (Request-ID: req-5c3e60e4-7525-47a2-808d-d778fd7b0558) Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:05.569785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:05.571817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:29:05.576002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:05.582893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-528c062f-d24d-4019-bf49-8070a61da688 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] Returning 404 to user: Volume 24445965-345e-460e-a221-fb5b547b7f46 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:05.604780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-528c062f-d24d-4019-bf49-8070a61da688 tempest-VolumesGetTestJSON-2000774454 tempest-VolumesGetTestJSON-2000774454-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46" status: 404 len: 109 microversion: 2.1 time: 0.848056 Nov 02 12:29:05.610703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 6/8] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:04 2022] GET /compute/v2.1/os-volumes/24445965-345e-460e-a221-fb5b547b7f46 => generated 109 bytes in 856 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:05.670403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe139d56-4c74-41bc-b493-beb78b534d72 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.232149 Nov 02 12:29:05.689471 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 3/9] 10.222.0.85 () {60 vars in 1162 bytes} [Wed Nov 2 12:29:04 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:05.691657 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-615fe51c-9473-4dbf-96bd-eb531dd8f3ba tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf07868a60>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:05.785015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3305799e-059f-4dcb-84a4-d6901caacc3e tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077f3c10>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.048661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3305799e-059f-4dcb-84a4-d6901caacc3e tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/c635920f-05e2-426b-a655-da5526a8f375" status: 200 len: 350 microversion: 2.1 time: 0.271353 Nov 02 12:29:06.049350 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 4/10] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/os-volumes/c635920f-05e2-426b-a655-da5526a8f375 => generated 350 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:06.144784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-615fe51c-9473-4dbf-96bd-eb531dd8f3ba tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.459757 Nov 02 12:29:06.151929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 7/11] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:05 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:06.158004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8a64ec08-fe08-4e11-9350-d2033a43fb2f tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077f3820>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.294125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8a64ec08-fe08-4e11-9350-d2033a43fb2f tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.139685 Nov 02 12:29:06.294996 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 5/12] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:06.306174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-68ea89de-9be4-4c5f-b7c3-e23afb429a35 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077d91f0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:06.391027 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68ea89de-9be4-4c5f-b7c3-e23afb429a35 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.088562 Nov 02 12:29:06.392158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 8/13] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:06 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:07.408631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ec56ff86-476d-4ee8-b20c-e841bff01aa6 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786ba60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:07.550517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ec56ff86-476d-4ee8-b20c-e841bff01aa6 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.149658 Nov 02 12:29:07.556116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 6/14] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:07 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:08.571662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8b721a9f-1d7c-4c63-95d9-4e618487a156 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077d98b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:08.692580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8b721a9f-1d7c-4c63-95d9-4e618487a156 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.130837 Nov 02 12:29:08.699982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 9/15] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:08 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:09.708618 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c532a24-e580-42a2-8ec1-19fa27fa8196 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786b1f0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:09.784954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5c532a24-e580-42a2-8ec1-19fa27fa8196 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 287 microversion: 2.1 time: 0.081010 Nov 02 12:29:09.797815 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 7/16] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:09 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 287 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:09.804949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-94d209e9-9783-45d5-be9f-0d0403a0598b tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf07868b80>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:09.938464 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-94d209e9-9783-45d5-be9f-0d0403a0598b tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "DELETE /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 202 len: 0 microversion: 2.1 time: 0.139050 Nov 02 12:29:09.942325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 10/17] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Nov 2 12:29:09 2022] DELETE /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:09.952247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-84bf554c-c312-4916-8c2e-0d93f116adbd tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786b700>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:10.042802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-84bf554c-c312-4916-8c2e-0d93f116adbd tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.096358 Nov 02 12:29:10.045578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 8/18] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:09 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:11.068927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-651ed560-a90f-4299-85e1-b3c67cf63403 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786b940>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:11.222654 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-651ed560-a90f-4299-85e1-b3c67cf63403 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.163369 Nov 02 12:29:11.224625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 9/19] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:11 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:11.367623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3a14a09e-3c88-45b3-b9c5-72648093f79b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: .version_select at 0x7faf077d9b80>, body: {"keypair": {"name": "tempest-keypair-1940074902", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMsX4lvqvdtjIVUl6Y3XnOxnczlXVPIAmUHiYYQ1dLBgoTP5ycsvX5ix0h5lMEd0Pi5wx4ZgRfvMZ2YmncofwlfH64SmNDtLv7mq1vx5h0ltQVbnmnQrgDvsnWqGhH2VeQ=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:11.538487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3a14a09e-3c88-45b3-b9c5-72648093f79b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:11.549831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3a14a09e-3c88-45b3-b9c5-72648093f79b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for user 83593f8338c444b7b117eeaf3e4cdcd5 and project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:11.662270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3a14a09e-3c88-45b3-b9c5-72648093f79b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.914352 Nov 02 12:29:11.663444 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 11/20] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Nov 2 12:29:10 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 917 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:29:12.243218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d195a6db-8a7c-4a33-9e32-6ffb39084af1 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077f3dc0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:12.454321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d195a6db-8a7c-4a33-9e32-6ffb39084af1 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 200 len: 286 microversion: 2.1 time: 0.219471 Nov 02 12:29:12.454914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 10/21] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:12 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 286 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:12.914045 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dd201cb8-052f-4049-bf5f-0156042d92e1 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077308b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.035268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dd201cb8-052f-4049-bf5f-0156042d92e1 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/02991c6f-58a0-416f-966c-96e621c0e877" status: 200 len: 350 microversion: 2.1 time: 0.125796 Nov 02 12:29:13.037140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 12/22] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:12 2022] GET /compute/v2.1/os-volumes/02991c6f-58a0-416f-966c-96e621c0e877 => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:13.059304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8da509c4-225b-4b99-8d4b-32f616465213 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077f3700>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.472558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a53eafc2-0299-42d5-b576-805fde568588 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077625e0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.570569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8da509c4-225b-4b99-8d4b-32f616465213 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.523281 Nov 02 12:29:13.571747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 11/23] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 525 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:13.599518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d37e870-f8f3-49ba-86da-1e758e703c17 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf0786b280>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:13.613147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-a53eafc2-0299-42d5-b576-805fde568588 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] HTTP exception thrown: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a53eafc2-0299-42d5-b576-805fde568588 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Request method failure captured: Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 HTTP/1.1 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKK2LcYz37sW32hK50BA0LzloGRGDLdZ4rSPyLXRlpIVpLRjhscQJ2XM1SNPqmVxQQbvbLWaELFyXZ-TKU_-TR1nwUVaqdgzb7yyp4z7q5OOL4zkcAeB5mx2a90RqKucKPRC_jgl0yG7oTBRzEYbiyUwyPD67u_dNe7rRx8v7vmbbU Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:13.616111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 338cd3b7a7b24bbc83d448e508bfaef6 Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '3aa94b95-4cba-469f-8be4-645aebe3eeb5'} Nov 02 12:29:13.618387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. (HTTP 404) (Request-ID: req-29ac4272-2028-404c-b25b-e4cd7f5f8c3b) Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.620461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:13.624201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Nov 02 12:29:13.634034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a53eafc2-0299-42d5-b576-805fde568588 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Returning 404 to user: Snapshot 3aa94b95-4cba-469f-8be4-645aebe3eeb5 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:13.638051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a53eafc2-0299-42d5-b576-805fde568588 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5" status: 404 len: 111 microversion: 2.1 time: 0.152352 Nov 02 12:29:13.640126 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 13/24] 10.222.0.85 () {58 vars in 1251 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/os-snapshots/3aa94b95-4cba-469f-8be4-645aebe3eeb5 => generated 111 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:29:13.640126 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05069b14-82bd-4675-8f7f-7c5b5e82f143 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf078684c0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:14.047523 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05069b14-82bd-4675-8f7f-7c5b5e82f143 tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33" status: 202 len: 0 microversion: 2.1 time: 0.419517 Nov 02 12:29:14.050338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 14/25] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:29:13 2022] DELETE /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 => generated 0 bytes in 423 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:29:14.060803 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05560652-bae1-4129-a993-284cb972b75e tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf07762430>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:14.078222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d37e870-f8f3-49ba-86da-1e758e703c17 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.483042 Nov 02 12:29:14.079220 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 12/26] 10.222.0.85 () {58 vars in 1149 bytes} [Wed Nov 2 12:29:13 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:14.104674 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72bdfb2c-35e3-4969-97da-f63d5992855d tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077ff5e0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:14.280400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-05560652-bae1-4129-a993-284cb972b75e tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] HTTP exception thrown: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05560652-bae1-4129-a993-284cb972b75e tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Request method failure captured: Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 HTTP/1.1 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKK2LcYz37sW32hK50BA0LzloGRGDLdZ4rSPyLXRlpIVpLRjhscQJ2XM1SNPqmVxQQbvbLWaELFyXZ-TKU_-TR1nwUVaqdgzb7yyp4z7q5OOL4zkcAeB5mx2a90RqKucKPRC_jgl0yG7oTBRzEYbiyUwyPD67u_dNe7rRx8v7vmbbU Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:14.282697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 338cd3b7a7b24bbc83d448e508bfaef6 Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'e692b4e3-9283-44ce-8645-1eb85f975a33'} Nov 02 12:29:14.284654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. (HTTP 404) (Request-ID: req-45a157fb-9b76-4de5-8953-57134b638293) Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.285844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:14.287384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:29:14.291768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-05560652-bae1-4129-a993-284cb972b75e tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Returning 404 to user: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-05560652-bae1-4129-a993-284cb972b75e tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33" status: 404 len: 109 microversion: 2.1 time: 0.230832 Nov 02 12:29:14.297627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 15/27] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:14 2022] GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 => generated 109 bytes in 233 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:29:14.373533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-72bdfb2c-35e3-4969-97da-f63d5992855d tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.272980 Nov 02 12:29:14.384539 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 13/28] 10.222.0.85 () {58 vars in 1134 bytes} [Wed Nov 2 12:29:14 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:14.396391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b8579e97-09af-4125-a58c-0132d5dca43a tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf077f19d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:14.492650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-b8579e97-09af-4125-a58c-0132d5dca43a tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] HTTP exception thrown: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b8579e97-09af-4125-a58c-0132d5dca43a tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Request method failure captured: Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 HTTP/1.1 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKK2LcYz37sW32hK50BA0LzloGRGDLdZ4rSPyLXRlpIVpLRjhscQJ2XM1SNPqmVxQQbvbLWaELFyXZ-TKU_-TR1nwUVaqdgzb7yyp4z7q5OOL4zkcAeB5mx2a90RqKucKPRC_jgl0yG7oTBRzEYbiyUwyPD67u_dNe7rRx8v7vmbbU Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:29:14.499509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 338cd3b7a7b24bbc83d448e508bfaef6 Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'e692b4e3-9283-44ce-8645-1eb85f975a33'} Nov 02 12:29:14.501443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. (HTTP 404) (Request-ID: req-025f20cc-8ebc-40e0-a194-310e4c083939) Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.510208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:14.511768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:29:14.517222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b8579e97-09af-4125-a58c-0132d5dca43a tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Returning 404 to user: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b8579e97-09af-4125-a58c-0132d5dca43a tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33" status: 404 len: 109 microversion: 2.1 time: 0.124817 Nov 02 12:29:14.522099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 14/29] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:29:14 2022] DELETE /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:14.529118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44de7488-e8b2-4c5c-a6cd-bafff56622fd tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf0786bca0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.044108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44de7488-e8b2-4c5c-a6cd-bafff56622fd tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.538726 Nov 02 12:29:15.057606 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 15/30] 10.222.0.85 () {58 vars in 1167 bytes} [Wed Nov 2 12:29:14 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:15.065647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-937645c4-4324-4d46-a946-57f85f3c73ae tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Calling method '.version_select at 0x7faf0786b280>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.366013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-587267965", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:15.452383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-937645c4-4324-4d46-a946-57f85f3c73ae tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] HTTP exception thrown: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-937645c4-4324-4d46-a946-57f85f3c73ae tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Request method failure captured: Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 HTTP/1.1 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKK2LcYz37sW32hK50BA0LzloGRGDLdZ4rSPyLXRlpIVpLRjhscQJ2XM1SNPqmVxQQbvbLWaELFyXZ-TKU_-TR1nwUVaqdgzb7yyp4z7q5OOL4zkcAeB5mx2a90RqKucKPRC_jgl0yG7oTBRzEYbiyUwyPD67u_dNe7rRx8v7vmbbU Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:29:15.454620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/4052f9d3c4f340eba358014a59e54a11"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 4052f9d3c4f340eba358014a59e54a11 Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1379283661 Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 338cd3b7a7b24bbc83d448e508bfaef6 Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1379283661-project Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'e692b4e3-9283-44ce-8645-1eb85f975a33'} Nov 02 12:29:15.456601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. (HTTP 404) (Request-ID: req-72d19221-e526-4de4-8e95-ac3aea32d5b4) Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:15.458528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:15.460716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:29:15.464892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-937645c4-4324-4d46-a946-57f85f3c73ae tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] Returning 404 to user: Volume e692b4e3-9283-44ce-8645-1eb85f975a33 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-937645c4-4324-4d46-a946-57f85f3c73ae tempest-VolumesSnapshotsTestJSON-1379283661 tempest-VolumesSnapshotsTestJSON-1379283661-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33" status: 404 len: 109 microversion: 2.1 time: 0.409688 Nov 02 12:29:15.478682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 16/31] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/os-volumes/e692b4e3-9283-44ce-8645-1eb85f975a33 => generated 109 bytes in 411 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:15.484075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5715cd01-3deb-426a-91e2-9d81e2782d04 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077f3dc0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:15.706452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] validate_networks() for [('d036ebb3-3fc9-46ee-88bb-f55457c5a308', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:15.753257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5715cd01-3deb-426a-91e2-9d81e2782d04 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.294952 Nov 02 12:29:15.754913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 17/32] 10.222.0.85 () {58 vars in 1170 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:15.769310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05cd5943-4eec-47f5-bff9-1dc5f3c6e3f2 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077f11f0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:16.091947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05cd5943-4eec-47f5-bff9-1dc5f3c6e3f2 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.326706 Nov 02 12:29:16.093723 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 18/33] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Nov 2 12:29:15 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:16.119553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-245362a8-9be8-43d5-b944-12f79f7794be tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf0786b700>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:16.656102 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-245362a8-9be8-43d5-b944-12f79f7794be tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.542339 Nov 02 12:29:16.656760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 19/34] 10.222.0.85 () {58 vars in 1188 bytes} [Wed Nov 2 12:29:16 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:16.680819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7eff7a1a-b940-4403-90d8-03a2852cfc02 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] Calling method '.version_select at 0x7faf077e69d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:17.182619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7eff7a1a-b940-4403-90d8-03a2852cfc02 tempest-VolumesTestJSON-1590783523 tempest-VolumesTestJSON-1590783523-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.507347 Nov 02 12:29:17.183760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 20/35] 10.222.0.85 () {58 vars in 1155 bytes} [Wed Nov 2 12:29:16 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:17.699541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-403461843", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "networks": [{"uuid": "2b7cd6b4-d388-4abb-b5ab-ec6598a0c773"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:18.021621 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] validate_networks() for [('2b7cd6b4-d388-4abb-b5ab-ec6598a0c773', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:18.743868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:18.744662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:18.746896 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:18.747643 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:18.748360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:18.811946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.812818 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.813628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.815034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:18.815878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:18.816660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:18.926902 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:18.950804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for user 7c5ccd8c99934f60b4ca26c4990b7412 and project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:18.996140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:19.013635 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:19.235813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d67e6500-d4c3-402a-8028-41a408aeeb35 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.918010 Nov 02 12:29:19.246542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 16/36] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 4921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:29:19.266255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1346179114", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06c5d739-a69b-4eff-a51e-383faef760f9"}], "security_groups": [{"name": "tempest-securitygroup--180337007"}], "key_name": "tempest-keypair-1940074902", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:19.625536 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] validate_networks() for [('06c5d739-a69b-4eff-a51e-383faef760f9', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:20.666236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:20.666786 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:20.666991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:20.667922 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:20.668455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:20.701153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.701940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.702666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.709778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:20.710277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:20.712176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:20.737013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:20.743823 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for user 83593f8338c444b7b117eeaf3e4cdcd5 and project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:20.767925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:20.779528 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:20.923342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-72afb39f-3dc1-4e7a-aa05-7c92b783368b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.682753 Nov 02 12:29:20.926173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 17/37] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Nov 2 12:29:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1688 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:29:20.939771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4003aecb-47a8-4962-97fa-7e3aa47da325 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:20.940859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4003aecb-47a8-4962-97fa-7e3aa47da325 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.141948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4003aecb-47a8-4962-97fa-7e3aa47da325 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.208176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4003aecb-47a8-4962-97fa-7e3aa47da325 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1221 microversion: 2.1 time: 0.279912 Nov 02 12:29:21.210229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 18/38] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:20 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1221 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:21.239820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:21.253417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:21.683831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.696840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.704193 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:21.710008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9a4ec15a-02f1-4594-afb6-b760b3ae0207 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1282 microversion: 2.20 time: 0.493553 Nov 02 12:29:21.721358 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 19/39] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:21 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1282 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:21.737931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-676352946", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:21.867363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] validate_networks() for [('d036ebb3-3fc9-46ee-88bb-f55457c5a308', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:29:22.300476 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:22.301749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:22.302684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:22.303590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:22.304887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:22.388557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.389460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.390205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.391195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:22.395902 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:22.396419 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:22.615479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Getting quotas for project 565eec3408344c2e84f2988fb2230c46. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:22.657820 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Getting quotas for user 8285583445bc4964a3b4b66b462d9212 and project 565eec3408344c2e84f2988fb2230c46. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:22.732524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:22.756509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:23.051052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11769d2b-1119-42c0-9be9-70da856c5df6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.866122 Nov 02 12:29:23.082549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 21/40] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 5888 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:29:23.109605 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.113555 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.374016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.410893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.416704 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.420665 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a98ab214-600f-49a8-8245-9911c0d18431 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1282 microversion: 2.20 time: 0.331378 Nov 02 12:29:23.421744 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 22/41] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1282 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:23.434665 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f23bdf48-5b68-46e7-ae87-031dd56bc49f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:23.435556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f23bdf48-5b68-46e7-ae87-031dd56bc49f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:23.602228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f23bdf48-5b68-46e7-ae87-031dd56bc49f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:23.674906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f23bdf48-5b68-46e7-ae87-031dd56bc49f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1214 microversion: 2.1 time: 0.245471 Nov 02 12:29:23.701800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 23/42] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:23 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1214 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:24.212185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:29:24.221331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:29:24.222443 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:29:24.225520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:29:24.226644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:29:24.260202 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.261850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.262560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.265672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.269791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.270963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.347532 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:29:24.371007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for user 7c5ccd8c99934f60b4ca26c4990b7412 and project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:29:24.426355 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:29:24.434194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:29:24.478647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.480281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.508722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.510861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.513081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.515641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:24.516544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:24.518682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:24.601090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6dbe1971-8e6b-4a4b-91df-416d15a50103 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.877146 Nov 02 12:29:24.603722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 20/43] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:29:21 2022] POST /compute/v2.1/servers => generated 383 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:29:24.618570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4ca9d2ad-5150-407c-931b-34bcfa4f7bd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.619467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4ca9d2ad-5150-407c-931b-34bcfa4f7bd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.778991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4ca9d2ad-5150-407c-931b-34bcfa4f7bd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.796154 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4ca9d2ad-5150-407c-931b-34bcfa4f7bd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1221 microversion: 2.1 time: 0.180442 Nov 02 12:29:24.798040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 21/44] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1221 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:24.810059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b37a5c9-0629-4ed5-acbd-86b12b6874c9 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:24.811291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b37a5c9-0629-4ed5-acbd-86b12b6874c9 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:24.916594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1b37a5c9-0629-4ed5-acbd-86b12b6874c9 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:24.929632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b37a5c9-0629-4ed5-acbd-86b12b6874c9 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1214 microversion: 2.1 time: 0.128343 Nov 02 12:29:24.930626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 22/45] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:25.020195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.055215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.057974 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:25.063352 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-865d3321-f9e0-4151-b054-859d226cb5b2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1278 microversion: 2.20 time: 0.591165 Nov 02 12:29:25.077991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 24/46] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:24 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1278 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:25.841566 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8cf5a6b5-57c5-4751-88e8-daafd0c7e054 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:25.842212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8cf5a6b5-57c5-4751-88e8-daafd0c7e054 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:25.972298 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:25.973721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:25.997807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.001347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.006867 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.007941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.008971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.013384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.723727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8cf5a6b5-57c5-4751-88e8-daafd0c7e054 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:26.739567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8cf5a6b5-57c5-4751-88e8-daafd0c7e054 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1221 microversion: 2.1 time: 0.901812 Nov 02 12:29:26.765039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 23/47] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:25 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1221 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:26.765491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:26.765651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:26.771702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:26.787386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-89b2d7a1-6193-41b0-8f80-c6b309a99dba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1210 microversion: 2.1 time: 0.817647 Nov 02 12:29:26.789608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 25/48] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:25 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1210 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:26.794496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.795411 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.796292 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:26.797447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:26.800795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:26.802341 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.361673 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.393054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.396002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:27.408749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6b1bfb3e-20b4-42cf-b4c2-522ca72a9bfd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1352 microversion: 2.20 time: 0.654437 Nov 02 12:29:27.411925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 24/49] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:26 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1352 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:27.796838 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.799933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.816572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.819170 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.822219 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.827168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.841826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.843682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.846655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:27.853072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:27.883687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.887682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.889125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:27.893229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:27.898083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:27.899820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:28.806996 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.851533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7b7a6cd2-389d-40fd-8180-b5eb5808cce8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 1.014984 Nov 02 12:29:28.886364 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 25/50] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:28.936289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:28.937877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:28.939950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:28.990714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:28.997031 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:29.006296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:29.012315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-722b0050-ee2c-4c90-807e-c56634eec926 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1273 microversion: 2.1 time: 1.219675 Nov 02 12:29:29.018099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:29.039362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.029s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:29.040071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:29.069629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 26/51] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:27 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1273 bytes in 1282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:30.043386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:30.103520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:30.113637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:30.149120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a22ac5af-d497-4864-b288-65d27f8ad1af tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1340 microversion: 2.20 time: 1.260838 Nov 02 12:29:30.150763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 26/52] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:28 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1340 bytes in 1264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:30.177771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:30.183850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:30.210678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.213366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.215949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.218922 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.222173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.226817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.480767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e8489b1-8277-4737-926a-840ba13d31af tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Action: 'create', calling method: .version_select at 0x7faf06e9d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1512993990", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e8489b1-8277-4737-926a-840ba13d31af tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 122 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:29:30.515561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1512993990", "metadata": {"Type": "work"}}} Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: Nov 02 12:29:30.517888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1512993990', 'metadata': {'Type': 'work'}}}} Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi '#$%' Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:30.522009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:29:30.527496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:29:30.533267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Nov 02 12:29:30.533267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:30.533267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3e8489b1-8277-4737-926a-840ba13d31af tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:30.533267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3e8489b1-8277-4737-926a-840ba13d31af tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.437932 Nov 02 12:29:30.534303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 27/53] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Nov 2 12:29:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1450 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:30.560133 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:30.563535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:30.611993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.615275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.625804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:30.627430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:30.628431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:30.637869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:31.028718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:31.071692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-eaff66dd-0ed2-4d9f-a2b9-479628ecca9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1279 microversion: 2.1 time: 0.534569 Nov 02 12:29:31.083314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 28/54] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:30 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1279 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:31.095178 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70f2f841-e357-4a4b-9d02-5245e7ec5499 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Action: 'create', calling method: .version_select at 0x7faf06e9d1f0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296562217", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70f2f841-e357-4a4b-9d02-5245e7ec5499 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 119 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:29:31.120921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-296562217", "metadata": {"Type": "work"}}} Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: Nov 02 12:29:31.123304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-296562217', 'metadata': {'Type': 'work'}}}} Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi '0' Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:31.124572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:29:31.131625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:29:31.133783 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Nov 02 12:29:31.133783 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.138423 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70f2f841-e357-4a4b-9d02-5245e7ec5499 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:31.139959 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70f2f841-e357-4a4b-9d02-5245e7ec5499 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.054737 Nov 02 12:29:31.141144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 29/55] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Nov 2 12:29:31 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 57 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:31.165280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99a94bd3-183b-4c9a-8f02-f4ae8f93ce5f tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Action: 'create', calling method: .version_select at 0x7faf06d2f3a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726407903", "metadata": {"Type": "work"}}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99a94bd3-183b-4c9a-8f02-f4ae8f93ce5f tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 119 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:29:31.181682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1726407903", "metadata": {"Type": "work"}}} Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: Nov 02 12:29:31.184081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1726407903', 'metadata': {'Type': 'work'}}}} Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise error Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi On instance['volume']: Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi '' Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:31.185575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Nov 02 12:29:31.187715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Nov 02 12:29:31.190101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Nov 02 12:29:31.190101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.190101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-99a94bd3-183b-4c9a-8f02-f4ae8f93ce5f tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:31.190101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-99a94bd3-183b-4c9a-8f02-f4ae8f93ce5f tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.035333 Nov 02 12:29:31.193422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 30/56] 10.222.0.85 () {60 vars in 1156 bytes} [Wed Nov 2 12:29:31 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:29:31.224624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:31.229118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:31.230452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:31.269244 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b5163936-4c49-426c-9ac7-197d05549787 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 1.098195 Nov 02 12:29:31.277479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:31.277479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:31.277479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:31.278055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 27/57] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:30 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 1124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:31.296325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:31.301930 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:31.302997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:31.321954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4057da1c-8f3a-4976-8551-ca02b423f1da tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Calling method '.version_select at 0x7faf06ddb0d0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:31.436226 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-4057da1c-8f3a-4976-8551-ca02b423f1da tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] HTTP exception thrown: Volume tempest-invalid-2013357206 could not be found. Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4057da1c-8f3a-4976-8551-ca02b423f1da tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-2013357206 HTTP/1.1 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:31.442221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Volume tempest-invalid-2013357206 could not be found. Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'tempest-invalid-2013357206'} Nov 02 12:29:31.443891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-2013357206 could not be found. (HTTP 404) (Request-ID: req-9d966f4b-371d-4da3-8b0a-ff6ad51c569c) Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.444817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:31.446381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-2013357206 could not be found. Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:31.447553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-2013357206 could not be found. Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-2013357206 could not be found. Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4057da1c-8f3a-4976-8551-ca02b423f1da tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 404 to user: Volume tempest-invalid-2013357206 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:31.449284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4057da1c-8f3a-4976-8551-ca02b423f1da tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/tempest-invalid-2013357206" status: 404 len: 99 microversion: 2.1 time: 0.165609 Nov 02 12:29:31.453760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 28/58] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Nov 2 12:29:31 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-2013357206 => generated 99 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:29:31.470921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f5b0337-288f-4095-985e-c206707485cc tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.015304 Nov 02 12:29:31.478535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 29/59] 10.222.0.85 () {58 vars in 1140 bytes} [Wed Nov 2 12:29:31 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 24 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:29:31.492920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-02d9abfd-2a86-436a-982c-341594e1768f tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007458 Nov 02 12:29:31.511637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 30/60] 10.222.0.85 () {58 vars in 1137 bytes} [Wed Nov 2 12:29:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 28 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Nov 02 12:29:31.520568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bcebcb75-308d-44e6-9b5c-371931a41d1d tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Calling method '.version_select at 0x7faf06daa3a0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:31.672667 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-bcebcb75-308d-44e6-9b5c-371931a41d1d tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] HTTP exception thrown: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bcebcb75-308d-44e6-9b5c-371931a41d1d tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/os-volumes/524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 HTTP/1.1 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:31.675908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '524bf2c2-7cf9-4737-97f6-2ed1ff3a4713'} Nov 02 12:29:31.678426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. (HTTP 404) (Request-ID: req-a792b4bd-4027-410e-93a9-1c2e46c892df) Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.680389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._delete(loc) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Nov 02 12:29:31.684687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Nov 02 12:29:31.686690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bcebcb75-308d-44e6-9b5c-371931a41d1d tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 404 to user: Volume 524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bcebcb75-308d-44e6-9b5c-371931a41d1d tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "DELETE /compute/v2.1/os-volumes/524bf2c2-7cf9-4737-97f6-2ed1ff3a4713" status: 404 len: 109 microversion: 2.1 time: 0.168302 Nov 02 12:29:31.689258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 31/61] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:29:31 2022] DELETE /compute/v2.1/os-volumes/524bf2c2-7cf9-4737-97f6-2ed1ff3a4713 => generated 109 bytes in 176 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:31.719785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ff77af9-cf28-451d-87f5-265a12b1a0e6 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Calling method '.version_select at 0x7faf06d74550>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:31.803824 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-8ff77af9-cf28-451d-87f5-265a12b1a0e6 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] HTTP exception thrown: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ff77af9-cf28-451d-87f5-265a12b1a0e6 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Request method failure captured: Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/os-volumes/726551b7-189a-4568-a9ab-b21c8d478885 HTTP/1.1 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKoSkxzLRqR_5D7z7PUpkf5z9t657dXWkdqcsQF4m3uw51KubwKSl6C1wPIEsoaOf9xidb-dlO69iewWmic3qeRj7gU9SDZeq9Wm2sTYBGeGWB50VF3QJR9JNlNnzNOjAcXSdCHA4d-tGvnY7idpsFQz5bqenEwkqVSC0ZCCBZcOZw Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:29:31.806237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_bc387749af3b48729d467782a55262d3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/bc387749af3b48729d467782a55262d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/bc387749af3b48729d467782a55262d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: bc387749af3b48729d467782a55262d3 Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesNegativeTest-583996274 Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 557e0ee320e84adeb03ccdd4f8559577 Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesNegativeTest-583996274-project Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '726551b7-189a-4568-a9ab-b21c8d478885'} Nov 02 12:29:31.809375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. (HTTP 404) (Request-ID: req-dc60b049-2cab-4b32-ad82-ec9d9ac33676) Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.811784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi item = cinderclient( Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Nov 02 12:29:31.814167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Nov 02 12:29:31.816164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ff77af9-cf28-451d-87f5-265a12b1a0e6 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] Returning 404 to user: Volume 726551b7-189a-4568-a9ab-b21c8d478885 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ff77af9-cf28-451d-87f5-265a12b1a0e6 tempest-VolumesNegativeTest-583996274 tempest-VolumesNegativeTest-583996274-project] 10.222.0.85 "GET /compute/v2.1/os-volumes/726551b7-189a-4568-a9ab-b21c8d478885" status: 404 len: 109 microversion: 2.1 time: 0.109287 Nov 02 12:29:31.820212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 32/62] 10.222.0.85 () {58 vars in 1245 bytes} [Wed Nov 2 12:29:31 2022] GET /compute/v2.1/os-volumes/726551b7-189a-4568-a9ab-b21c8d478885 => generated 109 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:29:32.113428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:32.114148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:32.143790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.144635 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.151504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.161451 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.162729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.169858 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.517739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:32.593727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.618867 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.633459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.638461 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3c94ed7a-273f-48eb-acf0-53d2700b4c37 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 1.440968 Nov 02 12:29:32.641536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 31/63] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:31 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:32.651999 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:32.652836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:32.663291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.664361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.665138 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.667160 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:32.668624 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:32.669848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:32.721968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.761864 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f578033d-7026-4978-b851-71483a8f8eb7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1279 microversion: 2.1 time: 0.632672 Nov 02 12:29:32.797202 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 33/64] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:32 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1279 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:32.929101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:32.958975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da2b0cb9-56e1-4403-b525-c57160235f8b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 0.315932 Nov 02 12:29:32.964666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 32/65] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:32 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:33.676986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:33.678286 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.710147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.711518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.712643 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.717878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.718940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.723903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.819381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:33.820630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:33.839683 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=10 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:33.873267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.879950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.883440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:33.886451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:33.892174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:33.895853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.298741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:34.690499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:34.712291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08c683a7-6a6b-4ad5-8630-91d1fdf51345 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1279 microversion: 2.1 time: 0.908447 Nov 02 12:29:34.714594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 33/66] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:33 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1279 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:34.756980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:34.758078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:34.773839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.774869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.775467 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:34.776491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:34.777142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:34.777641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.107321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:35.130504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7870de75-ca6b-4776-8f87-4ba1bf995454 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 0.412848 Nov 02 12:29:35.141730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 34/67] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:34 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:35.693413 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:35.710119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:35.715805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:35.719716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f8745481-4125-4ee7-8cb4-7182034711ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 2.050955 Nov 02 12:29:35.721279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 34/68] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:33 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 2053 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:35.756493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:35.757683 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:35.770070 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.771092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.771770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:35.772752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:35.773464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:35.774104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.158867 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.168714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5b620212-bc49-4877-a028-5813f36d1962 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1279 microversion: 2.1 time: 0.417130 Nov 02 12:29:36.185773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 35/69] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:35 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1279 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:36.186501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.187132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.208448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.212564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.214393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.217119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.218944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.221572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.558212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:36.580074 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2f3266a0-29d6-40dd-98a5-0ec77105dc4b tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 0.397705 Nov 02 12:29:36.585788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 35/70] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:36.760602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:36.764358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:36.796450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.796450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.798217 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:36.802485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:36.805518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:36.808586 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.202746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:37.202746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:37.202746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=32 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:37.224372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.225231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.225980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.239504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:37.241168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:37.242032 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:37.939803 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:37.950878 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:37.975974 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-901a4bf7-0322-4cb2-a5ef-71bfcb0292d3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1279 microversion: 2.1 time: 0.779255 Nov 02 12:29:37.999118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.003449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 36/71] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:37 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1279 bytes in 810 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:38.009558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.017059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2902d86d-a0dc-4a1f-9ee5-f1569317223e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 1.267345 Nov 02 12:29:38.019229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 36/72] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:36 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:38.020180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:38.021052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:38.029416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:38.037342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.038225 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.038889 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:38.040317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:38.041142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:38.042567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:38.262845 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:38.297266 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-67a1fc4a-ef95-4b05-aae6-b584b4bf0852 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1272 microversion: 2.1 time: 0.290956 Nov 02 12:29:38.298582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 37/73] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:38 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1272 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:39.039107 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:39.044415 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:39.070093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:39.158206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.160392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.164890 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.174448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.185177 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.188510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.208228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.213731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.217098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.298263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Creating event network-changed:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:29:39.320074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:29:39.320933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d8919679-4b53-47d3-ac8a-b37af3e72bf8 req-3895b12f-0f3b-402a-a5c3-0ac8a4b4622b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:29:39.324952 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.325823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.326489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.329660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.333547 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.334406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.362103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.compute.rpcapi [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:29:39.370667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] Releasing lock "compute-rpcapi-router" {{(pid=120739) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:29:39.408144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-510ca80f-ab9f-40c3-acb3-9c7fe3cdcc00 None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.928836 Nov 02 12:29:39.410015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 37/74] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:39.428296 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:39.430068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:39.459282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.464941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.466883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.470037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:39.470881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:39.475616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:39.900962 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:39.950865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:39.958987 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:39.985464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a8f797a5-1fe6-4570-aa44-f3f198023391 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.571807 Nov 02 12:29:39.989732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 38/75] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:40.013454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:40.014661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:40.027173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:40.073775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.075884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.080776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.088020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:40.090914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:40.097117 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:40.976727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:40.989530 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0804bcf2-7cf3-47be-bf62-6f999f7f3712 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.991968 Nov 02 12:29:40.993145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 39/76] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 1002 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:41.018498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:41.019333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:41.033281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.037773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.038473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.039503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:41.040211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:41.042686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:41.307672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:41.317793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7717f834-f205-436d-9551-310dc41d6186 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 2.312420 Nov 02 12:29:41.318380 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 38/77] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:39 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 2316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:42.019590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:42.026192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.026951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.044595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:42.060270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.060796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.061296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.062073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.078180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:42.083469 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.085304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-de700522-8d1b-4b96-900d-073b52ccc663 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 1.071450 Nov 02 12:29:42.091129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.097076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 40/78] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:41 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 1084 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:29:42.342144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:42.342954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:42.364336 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.366944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.368862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:42.372206 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:42.374169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:42.375248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.198178 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.213864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-785a0d66-2a68-4a51-a1e4-0669dc2f1310 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.877128 Nov 02 12:29:43.216378 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 41/79] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:43.223923 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:43.228563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:43.242299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.243146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.243667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.244826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.247930 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.250762 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.497560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.509608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.511455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.512280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:43.519312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-50c104bb-b692-442c-b679-7969c56e3c9b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.293398 Nov 02 12:29:43.520009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 42/80] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:43 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:43.525790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-db61e2d4-2b10-495d-a83c-beb0ef359704 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 1.511743 Nov 02 12:29:43.543404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 39/81] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:42 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 1514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:43.751228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3fc268ed-bf55-4bb7-a64b-66e569798119", "tag": "1ca93775-d02f-4a64-aedd-28dd21814b95"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:43.791906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:43.792784 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:43.793567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:43.844646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] Creating event network-changed:1ca93775-d02f-4a64-aedd-28dd21814b95 for instance 3fc268ed-bf55-4bb7-a64b-66e569798119 on hv-cinder-86327 Nov 02 12:29:43.868090 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-22d22c6e-5775-45ac-94bf-7476c049fcec req-9f8aa4d3-893e-4ac1-b680-86fc6de7f59a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241403 Nov 02 12:29:43.869493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 43/82] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:44.245285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.245913 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.279229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.279744 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.280193 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.280924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.297524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.297992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.548801 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.550573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.566299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.566809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.567244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.570386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.571148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.573584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.587543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:44.919126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:44.934792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:44.937359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:44.939113 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c7415469-a347-4e3f-927c-39bd1f4f61f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.397011 Nov 02 12:29:44.953029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 44/83] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:44 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:29:44.953029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:44.953343 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:44.966568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.967080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.967835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:44.969484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:44.971254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:44.972030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.267650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.298699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fb413f78-d2ae-476a-9022-e9beb66cc5ba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.355266 Nov 02 12:29:45.309655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 45/84] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:44 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:45.335462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:45.352265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a1e7ceb3-4e72-4321-8d6a-5266709f4875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 1.112242 Nov 02 12:29:45.356392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 40/85] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:44 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 1118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:45.914968 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d700e60e-c573-4867-af81-4967f45d07ff", "tag": "c0732d77-2305-43de-9231-76f0cfe969f9"}, {"name": "network-changed", "server_uuid": "6abe4375-8644-4b59-b685-70841201f7a0", "tag": "9bf5b234-1337-4a82-8124-bea80c600265"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:45.942395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.943019 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.943587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.970781 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:45.971493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:45.979472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Creating event network-changed:c0732d77-2305-43de-9231-76f0cfe969f9 for instance d700e60e-c573-4867-af81-4967f45d07ff on hv-cinder-86327 Nov 02 12:29:45.980507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] Creating event network-changed:9bf5b234-1337-4a82-8124-bea80c600265 for instance 6abe4375-8644-4b59-b685-70841201f7a0 on hv-cinder-86327 Nov 02 12:29:45.987716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.988317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.988897 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:45.991346 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:45.991790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:45.993146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-3da0f81c-56e5-4c9e-a1ad-cb5a303e3b71 req-ad971766-cb02-4127-97ed-8cda6597d520 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.084078 Nov 02 12:29:45.994923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.003144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 46/86] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:46.262679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.272949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.274941 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.277085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-43bc5052-6879-474c-89ad-029153fd4562 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.312296 Nov 02 12:29:46.298257 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 41/87] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:45 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:46.328947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.329809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.343878 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.344466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.344913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.345981 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.347006 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.348908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.380548 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:46.381972 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:46.396475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.396978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.397443 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.398175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:46.398632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:46.399054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:46.726634 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.738331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a4c4b151-7baa-4a2f-aa73-d03dd0d7a6e1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.362162 Nov 02 12:29:46.739165 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 42/88] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:46.742740 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:46.760131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe8ca032-7728-4714-9caf-04c6408c2bc6 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.435339 Nov 02 12:29:46.762267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 47/89] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:46 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:47.303454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.304174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.314060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.314551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.317650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.318412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.319050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.319490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.504406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.516884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.531206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:47.533446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2cea7ec5-649e-4d03-af2f-5dfaefae9c65 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.232946 Nov 02 12:29:47.533844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 43/90] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:47.779148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.779946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.787462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.788641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.789285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.790514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.791358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.791902 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.804285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:47.805716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:47.814054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.815542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.816793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.817764 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:47.818426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:47.819037 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:47.842860 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:47.992472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.004932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e4abddcd-04bc-4122-a006-d36bf74b6711 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.232940 Nov 02 12:29:48.015118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 48/91] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:48.308619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:48.320399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf57fb41-665b-4a50-9fbe-80602f107b79 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.521503 Nov 02 12:29:48.337247 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 44/92] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:47 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:48.563387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:48.564478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:48.592241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.593164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.593972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:48.600954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:48.602434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:48.606028 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.033169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:49.034508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:49.050356 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.051385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.052684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.056210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.057542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.059082 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.096206 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.131784 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.137484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.144121 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da6ee8a0-3065-43ed-a9c9-7a0d676ed7d5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.587292 Nov 02 12:29:49.156395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 49/93] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:48 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:49.350902 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:49.360297 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:49.368810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.380194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d1f4f924-966c-42b6-93c0-97142e3d1ae9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.352803 Nov 02 12:29:49.393157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:49.394023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.394833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.395134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 45/94] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:49 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:49.409732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.410510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:49.410984 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:49.411410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:49.831532 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:49.841810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b7091a5f-3890-46e8-a294-596d55a5015f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.499412 Nov 02 12:29:49.842397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 50/95] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:49 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:50.216040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.218162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.230213 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.231560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.233230 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.234900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.236865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.238235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.420879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:50.426395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:50.457293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.459091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.459892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:50.474169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:50.475199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:50.476000 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.068789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.094069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d0b7d950-a988-4f87-b5f1-e81754b289cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.687733 Nov 02 12:29:51.099967 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 51/96] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:51.129557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:51.130277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:51.147577 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.148169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.148621 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.152084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:51.152924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:51.155445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:51.531444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.547386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4b0ffcbb-60f6-467a-92e2-14098c3659db tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.444089 Nov 02 12:29:51.551528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 52/97] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:51 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:51.876307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.912578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.928417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:51.931235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a2611f03-1d91-493e-a2cc-0327c572b371 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 1.732537 Nov 02 12:29:51.932689 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 46/98] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:50 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 1738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:52.131777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:52.141587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:52.157481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.158802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.162919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.164613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.167944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.170499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.622538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "name": "network-vif-plugged", "status": "completed", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:52.639076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.640909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.644632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.671011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] Creating event network-vif-plugged:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:29:52.685647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bb5a3879-74ba-4254-9fbb-dc894080e6a2 req-5f0d0218-4a93-4a16-9820-aaec44950177 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.654381 Nov 02 12:29:52.687939 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 53/99] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:52.700353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:52.704990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:52.723161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.725736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.726579 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:52.729299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:52.732454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:52.735721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.138954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.148155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c1abfbe1-0488-4c3b-828d-cfff1fe44287 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.456336 Nov 02 12:29:53.158112 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 54/100] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:52 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:53.169232 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:53.169862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:53.206628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.207233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.207685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.208430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:53.208897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:53.213274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:53.262905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.274331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-73170b8c-89bf-4f53-831d-4f9caf314a6e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 1.149191 Nov 02 12:29:53.290388 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 47/101] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:52 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 1166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:53.717374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.735489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.743605 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:53.748915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3eac3392-cf0b-4b02-bd0d-8ffdc44a20f4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.587188 Nov 02 12:29:53.752377 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 55/102] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:53 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:54.208431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.210987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.227181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.228518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.229826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.231548 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.232726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.233911 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.305532 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.306223 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.322083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.324049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.324886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.326346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.327189 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.329180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.636719 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.647703 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-404b36bc-0d48-4c7e-b33b-3f3cbedbc917 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.348083 Nov 02 12:29:54.648635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 56/103] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:54.750544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc268ed-bf55-4bb7-a64b-66e569798119", "name": "network-vif-plugged", "status": "completed", "tag": "1ca93775-d02f-4a64-aedd-28dd21814b95"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:54.774014 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.774737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.776111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.807245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] Creating event network-vif-plugged:1ca93775-d02f-4a64-aedd-28dd21814b95 for instance 3fc268ed-bf55-4bb7-a64b-66e569798119 on hv-cinder-86327 Nov 02 12:29:54.820753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-f221f372-24a5-4652-8c66-ab4994cb3b45 req-3abeaf9b-c3f3-4005-9204-8ac7c3053130 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075462 Nov 02 12:29:54.822318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 57/104] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:54.833843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:54.834587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:54.846920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:54.849902 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.851122 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.851657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.852550 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:54.853909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:54.854545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:54.874851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a34af862-eec0-42da-b630-6722e96c226e tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.667672 Nov 02 12:29:54.876534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 48/105] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:55.204392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.221836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.227985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:55.230465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5433ba20-3345-4fd1-87dd-049459bbd6bd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1407 microversion: 2.20 time: 0.406765 Nov 02 12:29:55.231073 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 58/106] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:54 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:55.695232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.697750 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:55.720966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.723565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.726990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.729161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.730449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.731581 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.902541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:55.903381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:55.913051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.913765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.914246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:55.914960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:55.915434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:55.916043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.019192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.032712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-50849126-9bed-4be0-8c10-b2ae8be82744 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.350859 Nov 02 12:29:56.048486 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 49/107] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:55 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:56.262835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:56.263457 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:56.282371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.284277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.284916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.288192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.288717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.289170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.438394 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.457442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41983bfa-e3d5-48ed-af81-2e85aed7cac4 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.561099 Nov 02 12:29:56.458503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 59/108] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:55 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:56.681376 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.697136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.698828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:56.705050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-149975e1-2e35-4ecb-8e4a-0eddb8c001ea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1598 microversion: 2.20 time: 0.446502 Nov 02 12:29:56.717667 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 50/109] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:29:56 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1598 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:29:56.735865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:56.736834 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:56.745448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.746287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.746889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.748134 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:56.748869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:56.750389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:56.957375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5b3f32c-7850-49c1-98ed-d5bef836d1b5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.225569 Nov 02 12:29:56.966506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 60/110] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Nov 2 12:29:56 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-interface => generated 284 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:29:56.993160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abe4375-8644-4b59-b685-70841201f7a0", "name": "network-vif-plugged", "status": "completed", "tag": "9bf5b234-1337-4a82-8124-bea80c600265"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:57.029196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.030509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.030982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.080792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:57.081474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:57.086222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Creating event network-vif-plugged:9bf5b234-1337-4a82-8124-bea80c600265 for instance 6abe4375-8644-4b59-b685-70841201f7a0 on hv-cinder-86327 Nov 02 12:29:57.086759 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 02 12:29:57.087162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-711e4b42-9d40-475c-a416-70adc8cf42ba req-878a6980-5c34-4280-a5c8-803ab7412bde service nova] Acquired lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Nov 02 12:29:57.088305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.088769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.092419 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.092910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.101880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.102484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.104945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.105909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.106644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.107300 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.107945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.113284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.142389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.compute.rpcapi [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Nov 02 12:29:57.156277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] Releasing lock "compute-rpcapi-router" {{(pid=120740) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Nov 02 12:29:57.187329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-68a68bdc-952b-438e-b759-55a7241d737d None None] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198578 Nov 02 12:29:57.188501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 51/111] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:29:57.485567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:57.488108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:57.517081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.522058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.524427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.528479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:57.531882 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:57.532576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:57.533254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:57.550778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ed56b71d-a2df-44ed-a492-e665a7485d0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.474067 Nov 02 12:29:57.553586 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 61/112] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:57 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:29:58.600118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:58.601608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:58.609715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.610347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.610900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.611707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:58.612542 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:58.613239 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:58.806953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:58.820333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-86f469e1-8410-480b-b721-56d1ab3c80e4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.224049 Nov 02 12:29:58.821785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 62/113] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:58 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:59.051134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:29:59.070228 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc3e8e5a-dea9-4ab3-84a1-debad7c6d633 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 1.591512 Nov 02 12:29:59.086267 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 52/114] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:57 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 1609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:29:59.242741 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d700e60e-c573-4867-af81-4967f45d07ff", "name": "network-vif-plugged", "status": "completed", "tag": "c0732d77-2305-43de-9231-76f0cfe969f9"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:29:59.280698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.281850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.283316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.291492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:29:59.310318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] Creating event network-vif-plugged:c0732d77-2305-43de-9231-76f0cfe969f9 for instance d700e60e-c573-4867-af81-4967f45d07ff on hv-cinder-86327 Nov 02 12:29:59.320829 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-317dfe5f-e68b-431a-84e8-fdea036d134d req-ab0076a3-1461-49f6-8f2b-5871ca561194 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088553 Nov 02 12:29:59.323146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 63/115] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:29:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:29:59.846075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:29:59.847117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:29:59.854478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.855374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.856027 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:29:59.857047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:29:59.857832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:29:59.858454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.118303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:00.119193 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:00.132448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.136448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.138038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.142169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.143004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.144059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.264696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:00.272711 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c4a64c0d-289b-49d4-b6a5-6c03a0918c85 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.431259 Nov 02 12:30:00.277438 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 53/116] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:29:59 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:00.295297 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:00.329558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:00.331514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:00.333861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:00.369114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] Creating event network-changed:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:30:00.382858 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-40d48494-f5bc-4edd-ab23-2d10eefbbe11 req-cbea1b10-b6a1-45d9-ad82-ec01f8b6e936 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091157 Nov 02 12:30:00.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 54/117] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:00.438875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:00.453904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5a6fa63d-36f0-4629-91e4-0bc696fd3474 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1314 microversion: 2.1 time: 0.341088 Nov 02 12:30:00.454908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 64/118] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:00 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:01.331290 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:01.333840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:01.356353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.357478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.358827 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.360877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.362052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.363087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.506964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:01.509882 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:01.520413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.521314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.521960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.524181 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:01.524910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:01.525945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:01.749093 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:01.760235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f7710975-756a-4cb4-bacd-7f16d2e5384f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1321 microversion: 2.1 time: 0.440186 Nov 02 12:30:01.761439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 55/119] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:01 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1321 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:01.954862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:01.966354 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f2763337-980b-474a-ac66-398dee6211a8 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1501 microversion: 2.1 time: 0.470526 Nov 02 12:30:01.969612 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 65/120] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:01 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1501 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:02.812233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:02.818588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:02.834632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.835440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.838526 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:02.841820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:02.843065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:02.844315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.190607 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:03.226502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f9a416ca-76c4-49d7-aa16-027e22a9ea13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1515 microversion: 2.1 time: 0.421231 Nov 02 12:30:03.230900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 56/121] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:02 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1515 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:03.261789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:03.263981 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.283184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.285216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.285716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.288819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.289689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.291841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.376486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'flavor' on Instance uuid d700e60e-c573-4867-af81-4967f45d07ff {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:03.624377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9421d500-6177-4d87-a956-22e820f74288"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:03.629666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.631853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-236c3acf-ffdd-4150-8342-c2c7cb3db5f8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff/action" status: 200 len: 32 microversion: 2.1 time: 0.376485 Nov 02 12:30:03.640344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 66/122] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:30:03 2022] POST /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff/action => generated 32 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:30:03.646505 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:03.647512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:03.650552 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.651735 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.652920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.654463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.655518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.655748 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.656326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.657031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.657298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.658203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:03.658915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:03.659580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:03.911982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:03.922743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f066a79c-c478-453f-8a04-0b14c5e4a8a7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.280658 Nov 02 12:30:03.938599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 67/123] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:03 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:04.950707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:04.952446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:04.964834 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.965852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.966574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.967618 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:04.968368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:04.969522 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:04.975660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-495e4319-17d8-4c04-a011-8ae841552b80 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "POST /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.376224 Nov 02 12:30:04.980501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 57/124] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:30:03 2022] POST /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0/os-volume_attachments => generated 194 bytes in 1384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:30:05.188203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:05.202895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e2a36515-8787-48eb-b7dc-99a29a959041 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.257814 Nov 02 12:30:05.203945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 68/125] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:04 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:06.242097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:06.245329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:06.259596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.261502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.262679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.264299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:06.265480 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:06.266937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:06.567959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:06.576795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b57e4934-ada6-4541-9388-e79d39b525a3 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.344020 Nov 02 12:30:06.577965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 58/126] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:06 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:07.615043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:07.615666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:07.622285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.622903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.623367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.624062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:07.624696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:07.625271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:07.855961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:07.865237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-73b6afc3-3745-40bf-8bb4-7ced3138bbf0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.254049 Nov 02 12:30:07.865982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 69/127] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:07 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:08.894026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:08.895979 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:08.903901 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:08.905696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=43 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:08.908236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:08.910162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:08.911482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:08.912886 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:08.913698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:08.915645 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:09.154159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:09.163777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-53418a5e-c16d-41ae-bceb-186ed84927b7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.276196 Nov 02 12:30:09.178496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 59/128] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:08 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:10.195965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:10.197150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:10.206517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=62 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:10.210855 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:10.212482 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:10.213352 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:10.214710 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:10.215531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:10.216275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:10.516448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:10.532047 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e8ac785-2052-43bc-8919-38667ba6a002 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.342360 Nov 02 12:30:10.532711 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 70/129] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:10 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:11.560392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:11.561243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:11.570662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.571354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.571799 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.573934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:11.574829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:11.577022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:11.951985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:11.957718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:11.983818 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-19bb418d-a676-4a20-acf9-411fcb8b9ff9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.428283 Nov 02 12:30:12.011052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 60/130] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:11 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:13.025733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:13.031771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:13.062465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.065527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.071679 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.074502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:13.077693 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:13.079005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:13.291613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:13.300011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ececd178-1c76-4fb1-9aff-82243fdd63cc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.280828 Nov 02 12:30:13.301828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 71/131] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:13 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:14.364288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:14.366832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:14.387084 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:14.388370 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:14.389303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.390753 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:14.391758 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:14.392686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:14.644123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:14.665169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6129e5de-2811-492f-a76c-1067cb59d012 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.321966 Nov 02 12:30:14.680034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 61/132] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:14 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:15.692473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:15.693677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:15.701351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.702334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:15.703043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:15.703761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:15.704367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:15.704926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:15.964120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:15.990707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c29d2b6c-eae5-46e6-a961-20538875b86a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.302086 Nov 02 12:30:15.993468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 72/133] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:15 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:16.882287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:16.884150 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:16.899189 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:16.900649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:16.901592 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:16.902886 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:16.903993 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:16.904959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:16.991938 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:30:17.049946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:17.051080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:17.098321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.110146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.110951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.112282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.113235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.113995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.223637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7c80a3cc-2583-4929-8181-6a2118a21bbd tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 204 len: 0 microversion: 2.1 time: 0.358605 Nov 02 12:30:17.229085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 62/134] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:16 2022] DELETE /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:17.237440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:17.238413 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:17.248232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.249957 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.250576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.251447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:17.251906 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:17.252476 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:17.438210 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:17.450515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d556a5d2-695b-464e-912f-d4c99c8bfbd8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.437717 Nov 02 12:30:17.451969 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 73/135] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:17 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:17.517727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:17.535884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21816747-16b5-4a9f-9608-405fd8eeaed3 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1553 microversion: 2.1 time: 0.304326 Nov 02 12:30:17.537448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 63/136] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:17 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1553 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:18.481442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:18.483279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:18.490157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.490966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.491625 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.493201 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.493895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.494642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.576423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:18.577895 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:18.642171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.642687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.643137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.648002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:18.648516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:18.649023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:18.720949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.738800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a215d593-a8dd-467a-9140-21fc9c7c29e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.263825 Nov 02 12:30:18.753326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 74/137] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:18 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:18.874458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:18.889231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ad099425-8858-4573-8c97-62e4a44c0bbc tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1553 microversion: 2.1 time: 0.331551 Nov 02 12:30:18.890315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 64/138] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:18 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1553 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:19.767284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:19.768142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:19.775323 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.776688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.777600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.778675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.779364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.780770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.915321 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:19.915875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:19.934231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.936519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.937439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:19.939253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:19.939970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:19.940682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:20.076098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:20.090285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3a21b528-432e-43f5-a6a1-83893e5f19af tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.327457 Nov 02 12:30:20.090903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 75/139] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:19 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:20.413530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:20.440920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d5d848ec-7af7-4892-9ac3-285ed2a87fba tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1553 microversion: 2.1 time: 0.530374 Nov 02 12:30:20.441530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 65/140] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:19 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1553 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:20.668074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6abe4375-8644-4b59-b685-70841201f7a0", "name": "network-vif-deleted", "tag": "9bf5b234-1337-4a82-8124-bea80c600265"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:20.688762 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:20.693752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:20.694760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:20.714926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] Creating event network-vif-deleted:9bf5b234-1337-4a82-8124-bea80c600265 for instance 6abe4375-8644-4b59-b685-70841201f7a0 on hv-cinder-86327 Nov 02 12:30:20.736935 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-10e1b1a6-a998-44f9-95b3-a1fa993c7c06 req-3bd1a7e5-f461-49e0-85a1-7e1578f800dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073480 Nov 02 12:30:20.739180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 76/141] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:30:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:21.114989 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:21.115699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:21.122254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.122728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.123162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.123873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.124338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.124742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.298499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:21.307990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-581a3507-563a-4451-9d29-33b2daade49c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.197605 Nov 02 12:30:21.308663 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 66/142] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:21 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:21.477808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:21.479368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:21.506014 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.506483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.506957 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.507797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.508800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.509258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.575140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:21.575694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:21.576387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:21.576888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lazy-loading 'fault' on Instance uuid 6abe4375-8644-4b59-b685-70841201f7a0 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:21.647035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:21.660726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d9e9045e-d626-45d8-8aff-d28acc697699 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1350 microversion: 2.1 time: 0.195232 Nov 02 12:30:21.664168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 77/143] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:21 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1350 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:22.335988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:22.337325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:22.345243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:22.346069 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:22.346760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.347509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:22.348174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:22.348938 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.595123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:22.603621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1928684c-ce82-4f04-8cd7-7a7c84533502 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.271663 Nov 02 12:30:22.604232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 67/144] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:22 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:22.686781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:22.688052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:22.694490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:22.694979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:22.695408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.696765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:22.697244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:22.697906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.735875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:22.736357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:22.736803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:22.737283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lazy-loading 'fault' on Instance uuid 6abe4375-8644-4b59-b685-70841201f7a0 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:22.742538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:22.822628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8285583445bc4964a3b4b66b462d9212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '565eec3408344c2e84f2988fb2230c46', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:22.831281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-184866bb-9ca3-4012-9800-09070d59808f tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 200 len: 1350 microversion: 2.1 time: 0.148284 Nov 02 12:30:22.832031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 78/145] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:22 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 1350 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:23.631248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.632296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.639888 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.640346 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.640933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.641851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.642534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.642967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.824987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:23.838101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4d9c4b34-4fb5-4a4e-8ec7-b8d0535d6524 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.211741 Nov 02 12:30:23.839427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 68/146] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:23.862741 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:23.863572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:23.871732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.872314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.872826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.874590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:23.875139 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:23.875751 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:23.894513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] HTTP exception thrown: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Request method failure captured: Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 HTTP/1.1 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKcfXL6dKu_Isgxrj85zNcFJcjdVs_zeZW20kidvACAcdJdapVd6Q4Kj6zXixMAHgZq40WK0jDLffGa8tKyy8496zep-1R3bRveBrD03v1_HJ_1IZeiAALpjz91Mm6n5aQFenmS_p8GeYJKPWVFdzlrc_chZHqlPKrrWkfOC53u_Wo Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:30:23.913570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_565eec3408344c2e84f2988fb2230c46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 8285583445bc4964a3b4b66b462d9212 Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:23.916734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '6abe4375-8644-4b59-b685-70841201f7a0'} Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:23.917715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:23.918928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:23.920030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Returning 404 to user: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:23.920030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-003dd05a-d85c-4d9f-bf8a-602c5c57fd2c tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 404 len: 111 microversion: 2.1 time: 0.058036 Nov 02 12:30:23.920030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 79/147] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:23 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:24.087603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:24.089947 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:24.096719 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.097486 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.098090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.098968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.099432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.099858 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.114858 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] HTTP exception thrown: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Request method failure captured: Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0/os-volume_attachments HTTP/1.1 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKcfXL6dKu_Isgxrj85zNcFJcjdVs_zeZW20kidvACAcdJdapVd6Q4Kj6zXixMAHgZq40WK0jDLffGa8tKyy8496zep-1R3bRveBrD03v1_HJ_1IZeiAALpjz91Mm6n5aQFenmS_p8GeYJKPWVFdzlrc_chZHqlPKrrWkfOC53u_Wo Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:30:24.119773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_565eec3408344c2e84f2988fb2230c46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 8285583445bc4964a3b4b66b462d9212 Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:24.122239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'server_id': '6abe4375-8644-4b59-b685-70841201f7a0'} Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:24.123533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:24.125593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:24.128639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Returning 404 to user: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:24.128639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7580679c-9094-49a2-bbe7-24291a2e7e09 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038021 Nov 02 12:30:24.128639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 69/148] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:30:24 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:30:24.865227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:24.866699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:24.872347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.872833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.873468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:24.874235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:24.874696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:24.875107 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:25.055570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:25.068048 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ab6aaa07-e4e4-47a7-b173-2209f994e674 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.206712 Nov 02 12:30:25.068914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 80/149] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:24 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:26.107628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.108913 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.121503 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.122363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.123178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.124393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.125798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.126703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.390120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:26.400855 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a0441f1e-c742-4aff-b072-683350cd389a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.301909 Nov 02 12:30:26.401756 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 70/150] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:26.448381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.448990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.455555 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.456122 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.456642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.457447 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.458029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.458512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.475471 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] HTTP exception thrown: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Request method failure captured: Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 HTTP/1.1 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKcfXL6dKu_Isgxrj85zNcFJcjdVs_zeZW20kidvACAcdJdapVd6Q4Kj6zXixMAHgZq40WK0jDLffGa8tKyy8496zep-1R3bRveBrD03v1_HJ_1IZeiAALpjz91Mm6n5aQFenmS_p8GeYJKPWVFdzlrc_chZHqlPKrrWkfOC53u_Wo Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:30:26.479128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_565eec3408344c2e84f2988fb2230c46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 8285583445bc4964a3b4b66b462d9212 Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.480677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '6abe4375-8644-4b59-b685-70841201f7a0'} Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:26.481569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.482931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.484257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Returning 404 to user: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:26.484257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f49e8eb-0599-4088-93d3-53f5a81bf1c2 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 404 len: 111 microversion: 2.1 time: 0.037609 Nov 02 12:30:26.484257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 81/151] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:30:26 2022] DELETE /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:26.488562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:26.489201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] [instance: 6abe4375-8644-4b59-b685-70841201f7a0] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:26.495340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.495852 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.496287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.497030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:26.497484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:26.497946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:26.513174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] HTTP exception thrown: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Request method failure captured: Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 HTTP/1.1 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKcfXL6dKu_Isgxrj85zNcFJcjdVs_zeZW20kidvACAcdJdapVd6Q4Kj6zXixMAHgZq40WK0jDLffGa8tKyy8496zep-1R3bRveBrD03v1_HJ_1IZeiAALpjz91Mm6n5aQFenmS_p8GeYJKPWVFdzlrc_chZHqlPKrrWkfOC53u_Wo Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:30:26.515409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_565eec3408344c2e84f2988fb2230c46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/565eec3408344c2e84f2988fb2230c46"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 565eec3408344c2e84f2988fb2230c46 Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-DeleteServersTestJSON-1663302412 Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 8285583445bc4964a3b4b66b462d9212 Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-DeleteServersTestJSON-1663302412-project Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.517374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '6abe4375-8644-4b59-b685-70841201f7a0'} Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:30:26.518361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. Nov 02 12:30:26.519423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:30:26.520562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] Returning 404 to user: Instance 6abe4375-8644-4b59-b685-70841201f7a0 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:30:26.520562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8db7a753-df5f-4822-8f30-7023f61d3476 tempest-DeleteServersTestJSON-1663302412 tempest-DeleteServersTestJSON-1663302412-project] 10.222.0.85 "GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0" status: 404 len: 111 microversion: 2.1 time: 0.032121 Nov 02 12:30:26.520562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 71/152] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:26 2022] GET /compute/v2.1/servers/6abe4375-8644-4b59-b685-70841201f7a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:30:27.444021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:27.444756 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:27.451398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.452397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.452397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.453274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:27.453843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:27.454478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:27.605640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:27.613720 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f87628d5-1144-4b2d-8168-bc788ffc9908 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.177343 Nov 02 12:30:27.614563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 82/153] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:27 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:28.643828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:28.645206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:28.659993 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.661101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.662071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.664485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:28.665805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:28.666564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:28.890439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:28.905705 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a01221be-bba0-4e33-b215-49cfe4ef3d6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.269517 Nov 02 12:30:28.913252 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 72/154] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:28 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:29.953914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:29.955706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:29.995068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:29.998172 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:30.002868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:30.004239 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:30.005222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:30.010202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:30.579768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:30.634051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-21f0fe2d-0b39-43fa-85a5-fc925fc4cf41 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.688239 Nov 02 12:30:30.637270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 83/155] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:29 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:31.682097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:31.682933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:31.692633 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.693251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.693801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:31.694539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:31.695573 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:31.696087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:32.074828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:32.092036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f49746c6-57eb-4595-aa4c-958a1da7090f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.414842 Nov 02 12:30:32.096720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 73/156] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:31 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:33.135263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:33.137583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:33.145340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:33.145842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:33.146326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:33.147006 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:33.147463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:33.147948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:33.335826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:33.345399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2264d381-2741-4c4b-9698-db1bc4b05282 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.214271 Nov 02 12:30:33.346258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 84/157] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:33 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:34.384255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:34.388503 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:34.411281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.412088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.412838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.414423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:34.415113 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:34.415801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:34.736066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:34.755217 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-075877af-c720-4f90-a0c7-dddd3528ad2d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.385589 Nov 02 12:30:34.759136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 74/158] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:34 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:35.807691 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:35.815316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:35.842494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.844533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.845486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:35.846451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:35.847413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:35.848247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:36.523381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:36.532545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5978277e-9f14-4239-b428-5b6b0af2d0db tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.744112 Nov 02 12:30:36.537431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 85/159] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:35 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:37.567414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:37.568299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:37.589550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.590047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.590502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:37.591215 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:37.597804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:37.598262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:38.586211 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:38.621963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-75555a82-4771-4709-91bd-add50aecb321 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 1.060153 Nov 02 12:30:38.622755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 75/160] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:37 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:39.686563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:39.692244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:39.733816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.756140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.757294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:39.758633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:39.762611 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:39.765808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:40.373818 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:40.392430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6bbd3ce5-e46e-45d9-ba13-226c3b6674ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.720925 Nov 02 12:30:40.393489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 86/161] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:39 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:41.436605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:41.440141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:41.450481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:41.456627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.457841 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.459578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.461474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:41.462384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:41.463180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:41.831462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:41.856209 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ee4f1bd7-28e9-4d9b-be6c-89b321285be7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.425067 Nov 02 12:30:41.863685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 76/162] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:41 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:42.889146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:42.890424 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:42.908795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=38 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:42.915503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.918594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.922436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:42.923290 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:42.923781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:42.924259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:43.407348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:43.443094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bc0753fd-8aed-4273-9403-7861f44f2210 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.555604 Nov 02 12:30:43.445059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 87/163] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:42 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:44.474529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:44.476619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:44.537267 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.538676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.540261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.566589 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:44.568509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:44.570342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:44.587484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:45.421830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:45.448678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-235ebc81-2dec-45bd-bf09-8bd188841d10 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.981042 Nov 02 12:30:45.456102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 77/164] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:44 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:45.500283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ecf5e8cd-52c1-49cd-ae4d-bce7db59ad20 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: .version_select at 0x7faf06b39430>, body: {"keypair": {"name": "tempest-keypair-2022384076", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA83JT6YUHF6hqyXpqYEGFiMOEsAbvr92Gx3SZHcvF8zaos0JlnfLOHt3AhtdYLQ/wiXR3Ghlq+fRUzXhUUbj9tpRnwSXv8Sr5csXXEW/mTmjjhJi346HVZfV5/Yb/1Kqw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:45.546626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-ecf5e8cd-52c1-49cd-ae4d-bce7db59ad20 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:45.575731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-ecf5e8cd-52c1-49cd-ae4d-bce7db59ad20 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for user aacb777ebdf445eca64d1e46c2bdeced and project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:45.711747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ecf5e8cd-52c1-49cd-ae4d-bce7db59ad20 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.435053 Nov 02 12:30:45.719446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 88/165] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:30:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:30:46.481668 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:46.483970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:46.495995 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.496917 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.507999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:46.512359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:46.514549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:46.518688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:47.008662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:47.018540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f4085485-7bbd-4eb7-a13d-965afc5f67d0 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.541851 Nov 02 12:30:47.034712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 78/166] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:46 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:48.044929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:48.045811 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:48.057409 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:48.058030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:48.058322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:48.059051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:48.059510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:48.059928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:48.717503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:48.769174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-836f43ac-53bc-45ba-b701-3d3f4e119ea4 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.726368 Nov 02 12:30:48.772919 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 89/167] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:48 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:48.990791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1613913145", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1cd3d90-2bea-43ce-84ec-dc31298b79c7"}], "security_groups": [{"name": "tempest-securitygroup--536043320"}], "key_name": "tempest-keypair-2022384076", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:49.198022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] validate_networks() for [('a1cd3d90-2bea-43ce-84ec-dc31298b79c7', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:49.800110 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:49.800632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:49.801220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:49.805651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:49.806770 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:49.807580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:49.812258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:49.823514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.824052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.824492 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.825335 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.828243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.829036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.837215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.838925 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.840453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.843532 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:49.855793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:49.858386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:49.900709 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:49.908409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for user aacb777ebdf445eca64d1e46c2bdeced and project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:49.923985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:49.927133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:50.093458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea3a98cf-884d-4fcb-96ba-6917da3f99d2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.108664 Nov 02 12:30:50.106215 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 79/168] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1122 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:30:50.117288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2ae4c709-824a-47cc-8725-70056337cb04 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:50.121975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2ae4c709-824a-47cc-8725-70056337cb04 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:50.285077 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ae4c709-824a-47cc-8725-70056337cb04 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:50.316350 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2ae4c709-824a-47cc-8725-70056337cb04 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1238 microversion: 2.1 time: 0.200279 Nov 02 12:30:50.318355 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 80/169] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:50 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1238 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:50.348035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-764742398", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "networks": [{"uuid": "d62e064f-fe22-410f-9e2a-c431b4b312b5"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:50.444261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] validate_networks() for [('d62e064f-fe22-410f-9e2a-c431b4b312b5', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:30:50.475991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:50.495126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-31b17579-7789-4066-acfa-9cd65e478c13 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1521 microversion: 2.1 time: 0.701708 Nov 02 12:30:50.495734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 90/170] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:49 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1521 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:51.371807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.377692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:51.414920 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.422372 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.425033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.431544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.432116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.432768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.528517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:51.539922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-42347486-0e62-4b04-a408-9e39788a0546 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1290 microversion: 2.1 time: 0.195238 Nov 02 12:30:51.557630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 91/171] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:51 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1290 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:51.562875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.563876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:51.572149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.573590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.574299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.575504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.576174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.576873 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.631383 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:30:51.634208 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:30:51.637792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:30:51.638824 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:30:51.639805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:30:51.703023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.704414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.709340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.712679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.715218 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.717747 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.819578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Getting quotas for project 8de43ea57f2b44229359e179314b2d15. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:30:51.825097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:51.832763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Getting quotas for user 6c07346fbdc44eda9b057abc0fcd209a and project 8de43ea57f2b44229359e179314b2d15. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:30:51.835377 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1c347d73-f1ab-4b49-a426-c65ff6566b3d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1501 microversion: 2.1 time: 0.276346 Nov 02 12:30:51.838883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 92/172] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:51 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1501 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:51.863006 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:30:51.871153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:30:51.875745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:51.877666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:51.903115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.908003 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.912154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:51.914954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:51.915544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:51.917297 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.019804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3821ace5-db6c-4416-83de-028f2b5b3529 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.676757 Nov 02 12:30:52.020487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 81/173] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:30:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 1678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Nov 02 12:30:52.038396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e3957187-a0c9-49a4-917e-139f061e3e68 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:52.043620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e3957187-a0c9-49a4-917e-139f061e3e68 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:52.256679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e3957187-a0c9-49a4-917e-139f061e3e68 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:52.279922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:52.285987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e3957187-a0c9-49a4-917e-139f061e3e68 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1213 microversion: 2.1 time: 0.256651 Nov 02 12:30:52.290109 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 82/174] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:52 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1213 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:52.290823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e4066692-91ad-4505-ae63-49fceccb2867 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1514 microversion: 2.1 time: 0.427783 Nov 02 12:30:52.292953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 93/175] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:51 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1514 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:52.565209 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:52.566059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:52.595015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:52.596508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:52.597154 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.598068 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:52.598871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:52.599520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:52.691188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:52.706652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51d594b8-d11f-4bed-af32-f82d5514586e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1298 microversion: 2.1 time: 0.146238 Nov 02 12:30:52.709961 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 83/176] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:52 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1298 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:53.325127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:53.326291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:53.337578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.338462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.339257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.340617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.341463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.342252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.350808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=79 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:53.453885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:53.464890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d828886f-803a-4f8e-9737-78b7e9c610be tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1217 microversion: 2.1 time: 0.147846 Nov 02 12:30:53.466468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 94/177] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:53 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1217 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:53.736288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:53.738572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:53.750441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.751534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.752270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.753707 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:53.755084 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:53.755850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:53.866196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:53.882301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-017eb17f-371e-45cb-8599-0d9b1d47401b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1298 microversion: 2.1 time: 0.151859 Nov 02 12:30:53.883389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 84/178] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:53 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1298 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:54.494415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.495291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:54.515016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.516363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.518200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.523019 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.524415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.525613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.546630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.547084 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:54.555901 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.557505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.558277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.559244 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.560281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.560978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.596466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2c08d8cf-afcb-436e-9bb7-0871dcd11fd5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/ips" status: 200 len: 151 microversion: 2.20 time: 0.053715 Nov 02 12:30:54.597375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 85/179] 10.222.0.85 () {60 vars in 1289 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/ips => generated 151 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:30:54.648964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:54.667076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-21b8db6a-1009-4e80-a3b8-0d17d9bb8f38 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1217 microversion: 2.1 time: 0.182112 Nov 02 12:30:54.668260 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 95/180] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1217 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:54.919964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:54.921726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:54.928792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.930095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.930783 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:54.931743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:54.932414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:54.933087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.078172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:55.096509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c7e2efaa-3a33-457e-baa9-7dad4534403e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1298 microversion: 2.1 time: 0.179887 Nov 02 12:30:55.098351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 86/181] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:54 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1298 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:55.703376 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:55.711050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:55.720110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:30:55.750598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.756376 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.757183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:55.758445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:55.773953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:55.774913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.119235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:56.128688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:56.129746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:56.136918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2d33506d-86a5-4077-9617-b71288f22a9f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1265 microversion: 2.1 time: 0.448346 Nov 02 12:30:56.141201 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 96/182] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:55 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1265 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:56.144366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.150714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.151554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.154902 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.158529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.160315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.196249 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:56.199153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:56.213667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.218747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.219640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.220480 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.222231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.222771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.274342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'flavor' on Instance uuid 3fc268ed-bf55-4bb7-a64b-66e569798119 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:56.387540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:56.396494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8332385c-7e47-4f3c-92c7-2466c501d7ab tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1296 microversion: 2.1 time: 0.279288 Nov 02 12:30:56.409324 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a5f29e1b-1121-48c2-8480-a7c4e5b65875 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/action" status: 200 len: 32 microversion: 2.1 time: 0.210000 Nov 02 12:30:56.410064 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 87/183] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:56 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1296 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:56.413195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 97/184] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:30:56 2022] POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:30:56.421829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:56.422806 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:56.429351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.430090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.430857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.433787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:56.434485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:56.435073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:56.715279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:56.738993 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-36338066-2f2d-49f9-bf72-0b29c0e3a175 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.319791 Nov 02 12:30:56.780426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 88/185] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:56 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.075167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:30:57.077052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.106363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.121126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.121126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.121126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.121126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.121663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.212289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.217446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.267751 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'flavor' on Instance uuid c684f91d-7d77-4303-99ad-d73b293539a4 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:30:57.315189 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.317684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.318226 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.321710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.322382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.322829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.601437 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:57.617849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c3ed92eb-989c-4e3e-80a9-abd126405587 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1265 microversion: 2.1 time: 0.431475 Nov 02 12:30:57.618854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 89/186] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1265 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.637084 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.637876 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.651992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.652672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.653756 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.655815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.657345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.658536 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.872687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8f52b916-e796-4039-885c-4578203a69e0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/action" status: 202 len: 0 microversion: 2.20 time: 0.803492 Nov 02 12:30:57.881948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 98/187] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Nov 2 12:30:57 2022] POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/action => generated 0 bytes in 814 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:30:57.892408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.894275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.907531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.908790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.910174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.911979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.913729 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.915117 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.929973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:57.940819 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cacb5bc2-df5c-4f68-a94d-6d86969f387c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.317544 Nov 02 12:30:57.941462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 90/188] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:57.948755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:57.950283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:57.964823 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.965400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.965851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:57.968329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:57.968875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:57.969494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.247395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.256320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.257787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.259233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd022cbd-2230-4f6d-8a91-ca3559a90f14 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.314496 Nov 02 12:30:58.260444 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 91/189] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:30:58.272785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.303174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8456e36c-ed6c-4fc7-9056-83c425572b29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.416544 Nov 02 12:30:58.303799 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 99/190] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:57 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:58.648674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:58.649623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:58.657706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.658550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.659309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.660814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.661626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.662432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.770226 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:58.783843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-56870e16-6a94-411f-9747-aec54097f1c4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1265 microversion: 2.1 time: 0.142189 Nov 02 12:30:58.784961 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 92/191] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:58 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1265 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:58.974387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:58.975049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:58.983367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.984111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.984763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:58.985910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:58.986672 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:58.987862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.236400 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.245146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5eca09d1-a4e7-49dd-8c02-3ff6f5359e2d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.274969 Nov 02 12:30:59.245990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 100/192] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:58 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:30:59.302994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.304952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.320410 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.321807 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.325420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.328654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.329380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.330113 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.330997 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.332130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.347105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.347934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.348411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.349197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.349647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.350645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.673559 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.690072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cc291f4e-1f9c-467f-9d67-83cf54585d4c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.365005 Nov 02 12:30:59.691422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 101/193] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:30:59.824521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:30:59.825486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:30:59.834493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.835000 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.835426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.836151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:30:59.836602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:30:59.837037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:30:59.933543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:30:59.946960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3064060d-30dd-421e-8249-e315a9104402 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1271 microversion: 2.1 time: 0.126333 Nov 02 12:30:59.948786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 102/194] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1271 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:00.178539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:00.192001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:00.193502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:00.194699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-13cfebe1-2ba7-42d5-b380-d2de462304ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.906060 Nov 02 12:31:00.195263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 93/195] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:30:59 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 908 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:00.285778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.286397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.297303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.298193 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.298790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.299715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.300384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.300951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.511345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:00.525174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4921a8ae-d50d-42af-8f91-ac24822cf1cb tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.243020 Nov 02 12:31:00.526789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 103/196] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:00 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:00.715542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.716263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.724620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.725425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.726056 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.727060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.727698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.728116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.974302 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:00.975106 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:00.986520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.991436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.992759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:00.994083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:00.997530 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:00.998344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.230068 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.245885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4e2ac5e8-9aa0-4118-ac18-4966d0511bae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.531165 Nov 02 12:31:01.247780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 94/197] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:00 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:01.262522 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.268784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.292220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.294188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.296140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.303710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.304586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.305403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.530970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.540435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7306dae7-7be7-43a8-ba9a-c138e19d1316 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1271 microversion: 2.1 time: 0.571551 Nov 02 12:31:01.542315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 104/198] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:00 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1271 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:01.590005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:01.590666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:01.602136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.614782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.615436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.615994 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.616716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.616866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.618505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:01.623273 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bf2445c5-409a-491d-9fef-be5405d9d76f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.372236 Nov 02 12:31:01.625278 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 95/199] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:01.638527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.639232 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.850143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e473906-98d3-4493-8449-d57838bdae8f", "tag": "c5761531-577c-4309-a7db-9bb6acfee9dc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:01.873744 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:01.886962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:01.889443 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:01.891078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:01.992641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] Creating event network-changed:c5761531-577c-4309-a7db-9bb6acfee9dc for instance 4e473906-98d3-4493-8449-d57838bdae8f on hv-cinder-86327 Nov 02 12:31:02.001079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-73b774d2-a825-4572-a728-febbb9d77155 req-1402fac3-5ebb-4385-8f83-7aa37b2a77ea service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.154560 Nov 02 12:31:02.002239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 96/200] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:02.016573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.046888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5c5c2191-6ac6-4d0c-8e4a-4bb7045d29f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.496095 Nov 02 12:31:02.047621 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 105/201] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:01 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:02.290619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=16 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:02.295550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.296366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.327555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.328058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.328500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.330027 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.332658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.333396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.573303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.573795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.609125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.611162 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.611801 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.616572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.617320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.617933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.737508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:02.748072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:02.751461 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cdf89483-f093-4606-872a-659c70c4a1e3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1271 microversion: 2.1 time: 0.184656 Nov 02 12:31:02.752214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 106/202] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1271 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:02.770795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:02.772443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:02.790281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.791760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.792432 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:02.793750 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:02.796832 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:02.797826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.153924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.164941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.166716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.177611 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0b655f3c-e3e6-4868-8719-b818e1eac71a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.414514 Nov 02 12:31:03.181049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 107/203] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:03.188938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:03.189974 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:03.197423 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.198220 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.199019 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.199893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.200716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.201568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.321309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.335160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ec68bd14-6252-4182-a505-e48034213e29 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 1.045324 Nov 02 12:31:03.342881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 97/204] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:02 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:03.451655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:03.474151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c2f6b20a-c6e5-4748-a4fc-44fee0f8d262 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.288050 Nov 02 12:31:03.476699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 108/205] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:03 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:03.780116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:03.781967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:03.815919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.816426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.816870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.817662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:03.818114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:03.818586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:03.823644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:04.131231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.154257 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-11a6a5c3-d6f3-4361-8993-f9bc87467d52 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1271 microversion: 2.1 time: 0.378759 Nov 02 12:31:04.155176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 98/206] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:03 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1271 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:04.212352 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.213084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.222950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.223446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.223880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.224658 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.225637 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.226056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.360562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.361379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.375929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.377249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.379566 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.382986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.383903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.384463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.426020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.436844 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.440073 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.442233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f9162f7e-9444-4dfd-82ed-a8484954f569 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.236127 Nov 02 12:31:04.443209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 109/207] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:04.502115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:04.503156 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:04.513069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.513870 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.514509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.515509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:04.516731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:04.517518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:04.782455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:04.795627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9aa55213-9f1b-4ec6-a5d4-ef4254e38bae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.297029 Nov 02 12:31:04.798024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 110/208] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.179574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.182424 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.196310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.197281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.198128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.199832 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.202372 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.203628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.303370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.312224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c0038a9f-2383-4b05-ad22-b69ec46e9298 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1271 microversion: 2.1 time: 0.137777 Nov 02 12:31:05.313564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 111/209] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1271 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.348681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.363636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6e12c24c-33ad-4752-ac89-a7039aab5583 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 1.007341 Nov 02 12:31:05.364747 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 99/210] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:04 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:05.483468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.485353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.492155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.493271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.493721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.494443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.497018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.498499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.746849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.777402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.779259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:05.781866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-441242f1-6eb0-44af-a912-0172aa731d68 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.312736 Nov 02 12:31:05.796983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 112/211] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:05.824931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:05.825577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:05.842583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.842583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.842583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:05.842583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:05.843352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:05.843352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.342485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.342485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.352800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.353854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.354598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.355883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.356813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.357762 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.539089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:06.549046 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c5b88780-1802-4f80-9a0a-91918bd8bba0 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.216402 Nov 02 12:31:06.549863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 113/212] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:06.556264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.557879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.565728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.566562 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.567212 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.567991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.569243 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.569731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.707919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:06.722900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cbe83c5e-141a-444e-b37c-fd7a26d18235 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.904883 Nov 02 12:31:06.723502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 100/213] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:05 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:06.753914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:06.767286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-675da9b4-d547-4dbd-9642-8ced2140d9f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.215622 Nov 02 12:31:06.769214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 114/214] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:06.816404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:06.817296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:06.831273 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.832087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.832615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:06.833583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:06.834095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:06.849187 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.247060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.258336 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.260796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.264507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ab96ca8-4273-4045-a2e0-fca7f60f3df3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.453043 Nov 02 12:31:07.265282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 101/215] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:06 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:07.578196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:07.580031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:07.594303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.595263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.596259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.598651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.599891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.600839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.751403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:07.752432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:07.779048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.779596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.780030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.781935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.784904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.785801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.859108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:07.868755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-af3915eb-f2e5-4f87-84a3-adfe5ccdf289 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.299107 Nov 02 12:31:07.869666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 115/216] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:07 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:07.874539 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:07.875169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:07.882644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.883128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.883577 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:07.884258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:07.884876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:07.885466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.039721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.049733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ef00f15-a290-4a9e-aa40-94de5152c157 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.178653 Nov 02 12:31:08.050529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 116/217] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:07 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:08.300128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.300789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.307315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.307877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.308509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.309439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.309904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.310331 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.433032 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.441978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8a5ee1c1-caac-44cc-a6c9-f7b3e535db05 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.697036 Nov 02 12:31:08.443283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 102/218] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:07 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:08.517282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.527674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a83e4a2-16c2-4753-9307-9de44a3f430f", "tag": "98b3c8ba-be36-40d6-85e4-1560f5301886"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:08.530361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.532035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:08.533569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08ae20f6-4696-47b6-af78-8fdb3b02fbb0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.238369 Nov 02 12:31:08.534689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 117/219] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:08.560398 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.561176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.561757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.575534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] Creating event network-changed:98b3c8ba-be36-40d6-85e4-1560f5301886 for instance 2a83e4a2-16c2-4753-9307-9de44a3f430f on hv-cinder-86327 Nov 02 12:31:08.586522 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-16e29384-2237-4de1-b6ba-88f1ae41cfb1 req-f63e4396-a317-4e46-900d-0110793c72c5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062546 Nov 02 12:31:08.587141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 103/220] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:08.894297 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:08.895745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:08.903182 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.904103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.904850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:08.905782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:08.906646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:08.907230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.078611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:09.079761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.086919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.087569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.088111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.088940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.089681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.090199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.239343 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.249355 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ed235eb7-f987-4443-adde-8753c532b06e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.359082 Nov 02 12:31:09.250552 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 118/221] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:08 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:09.262804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.272877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-49bdedb4-f964-4e77-ba80-9a2c900fa38a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.199759 Nov 02 12:31:09.274061 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 104/222] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:09 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:09.468979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:09.471362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.490310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.491441 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.492118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.495434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.497765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.498363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.565596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:09.567216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:09.576409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.578154 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.578703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.579868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:09.580615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:09.581307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:09.859406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.872047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.873636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:09.885613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b242698e-298f-4863-965b-69b54e27714c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.324485 Nov 02 12:31:09.893327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 105/223] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:09 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:10.021263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.032734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-13d7d8b8-07dd-46d1-9a22-11638563e2a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.569550 Nov 02 12:31:10.033358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 119/224] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:09 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:10.276333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.277677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.285047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.285728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.288188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.289307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.289959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.290575 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.314314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.315913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.335430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.338241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.339072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.342077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.342756 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.343192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.768432 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.787096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f36e7d39-d8bc-4784-aaa0-f8f4d30ccf6f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.490767 Nov 02 12:31:10.787745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 120/225] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:10.920545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:10.922287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:10.929382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:10.941201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-79af9651-e9d0-4d40-b18c-499588afd02a tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.669610 Nov 02 12:31:10.943825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.944526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.945540 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.946704 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:10.947526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:10.948197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:10.977283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 106/226] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.068765 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.070446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.091007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.091948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.093466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.097517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.098932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.100444 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.449616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.469562 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.477176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.478487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-30bec1a3-444e-4fab-ba7a-055de03ff173 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.568287 Nov 02 12:31:11.479246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 121/227] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:10 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:11.618881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:11.650899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-93efa235-1707-4dad-8a0c-b590cce67c97 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.586872 Nov 02 12:31:11.652433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 107/228] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:11.821453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:11.823498 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:11.826293 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:11.839548 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.840339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.840954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:11.842284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:11.843006 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:11.845298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.180703 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-50d7da12-0dfa-41fc-80d0-71bbe6e22c87 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Action: 'create', calling method: .version_select at 0x7faf06b0a8b0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1697924631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLsVA0OlqkRPjxHZG6vBoD+4delAPtcTUuWR0svnfR78cFCnCVpM4j51FlCr5QAIAagLwWd/1sDw4vGPfGYOVj8zgrkBC7ufCss0SNBVpdTLPz7wJ3xCQl6J5y4Da9wilA=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:12.209087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.220477 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7538dce9-6c85-4ce9-9fc4-aa40a9960fa8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.403726 Nov 02 12:31:12.222067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-50d7da12-0dfa-41fc-80d0-71bbe6e22c87 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Getting quotas for project 620e39db57f34948b5450e5b90c984cb. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:12.228096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-50d7da12-0dfa-41fc-80d0-71bbe6e22c87 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Getting quotas for user 20a4049d2b2b474a8a830d0702b9b1fa and project 620e39db57f34948b5450e5b90c984cb. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:12.234209 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 108/229] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:11 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:12.249371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.250584 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.258346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-50d7da12-0dfa-41fc-80d0-71bbe6e22c87 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.493080 Nov 02 12:31:12.259502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 122/230] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:31:11 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:12.266603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.267833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.268482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.269615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.270577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.271269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.532961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.535804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.561645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.563868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.564823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.570718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.572345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.575909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.630412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:12.687263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b1d4fe2e-cf0c-4c09-aa78-57dd06d4497f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.445589 Nov 02 12:31:12.688311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 109/231] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:12.724614 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:12.725765 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:12.763817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.772673 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.774403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.778368 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:12.780686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:12.781425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:12.981897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.020698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.035106 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.038393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-683d4c10-f2fa-40ee-a4c0-492957b71af1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.510632 Nov 02 12:31:13.043221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 123/232] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:13.251306 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.252335 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:13.263103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:13.266126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.267406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.268392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.269950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.271553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.272541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.305228 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.325893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:13.335131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-323aafa0-b6eb-42cf-8e56-9a1e8d8b5f12 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.636945 Nov 02 12:31:13.339320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 110/233] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:12 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:13.601870 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:13.616773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f758bd3e-c705-40ea-9bae-482f3da932ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.373222 Nov 02 12:31:13.618757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 124/234] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:13 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:13.713612 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:13.714676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:13.723428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.725042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.725995 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:13.726978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:13.727707 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:13.728491 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.032769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.067155 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-61c53e5e-a7dd-4403-aeef-62d1f7e0b9fe tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.357360 Nov 02 12:31:14.068912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 111/235] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:13 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:14.102523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.107515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.134383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.136831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.138030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.140544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.142697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.144715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.392914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.395875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.444515 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.447014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.453284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.462649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.464630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.466037 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.532555 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.544929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.546841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.555915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05483ba7-21fb-44f3-9966-a21dc6763a6b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.455296 Nov 02 12:31:14.573545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 125/236] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:14.648201 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:14.649800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:14.666903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.669768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.670491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.676985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:14.677860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:14.680148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:14.966882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:14.997913 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c76d9180-7c26-464f-9d0e-d91ea575fce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.619581 Nov 02 12:31:15.001733 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 112/237] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.023984 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e473906-98d3-4493-8449-d57838bdae8f", "name": "network-vif-plugged", "status": "completed", "tag": "c5761531-577c-4309-a7db-9bb6acfee9dc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:15.057616 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.059345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.062779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.108736 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] Creating event network-vif-plugged:c5761531-577c-4309-a7db-9bb6acfee9dc for instance 4e473906-98d3-4493-8449-d57838bdae8f on hv-cinder-86327 Nov 02 12:31:15.132103 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4164e793-6dc1-463d-b286-d4f55953282c req-194147ca-3416-4f24-9f8c-ed261342dd35 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.125505 Nov 02 12:31:15.133073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 113/238] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:15.141507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.149327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.171097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.173484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.174627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.176551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.179540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.181520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.423227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.440328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-45bb669d-0b6e-452d-a95b-1e53210984cf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.801643 Nov 02 12:31:15.458039 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 126/239] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:14 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 820 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.545272 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:15.559963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7cf8ec23-d1ae-4959-850d-369912ba7282 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.425416 Nov 02 12:31:15.573043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 114/240] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:15.581255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:15.582344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:15.599714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.601897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.604966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.607494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:15.617550 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:15.618699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:15.963549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.033478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.050057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.051109 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.054600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3b1f2544-2f83-494d-9f49-b72db4f15bab tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.476630 Nov 02 12:31:16.054865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.061332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 127/241] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:15 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:16.069311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.070035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.070625 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.072390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.073097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.073712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.452829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:16.472747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.478851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.517063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-06d0eb81-9134-4089-b9d2-a65937682bdc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.473809 Nov 02 12:31:16.518444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.519254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.519652 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.520403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.521225 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 115/242] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:16.524059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.526786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.606799 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:16.607411 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:16.615404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.615925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.616361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.628143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:16.629092 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:16.645624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:16.659638 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:16.994360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.036272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-de378351-9989-42f6-b7d3-cd84410f6948 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.575466 Nov 02 12:31:17.041351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 128/243] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 582 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:17.099658 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.101299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.115825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.117069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.118009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.119484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.121555 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.122502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.161537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.182240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-541f850d-3791-4b2e-bd17-928b69986694 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.574784 Nov 02 12:31:17.184814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 116/244] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:16 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:17.398698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a83e4a2-16c2-4753-9307-9de44a3f430f", "name": "network-vif-plugged", "status": "completed", "tag": "98b3c8ba-be36-40d6-85e4-1560f5301886"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:17.419736 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.421610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.422042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.476370 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] Creating event network-vif-plugged:98b3c8ba-be36-40d6-85e4-1560f5301886 for instance 2a83e4a2-16c2-4753-9307-9de44a3f430f on hv-cinder-86327 Nov 02 12:31:17.500856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-f9cbb6ee-1b85-4461-ba62-7ff89b94bbde req-a12e61bf-3d39-488b-9d01-691612984608 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106437 Nov 02 12:31:17.502086 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.502994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 117/245] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:17.522990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.527586 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.531608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a8f5931d-4066-4f88-a919-3e7025cad242 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1744 microversion: 2.20 time: 0.444745 Nov 02 12:31:17.533565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 129/246] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1744 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:17.545702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:17.546547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:17.564906 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.565457 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.565904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.566598 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:17.567047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:17.567466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:17.973272 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:17.982847 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ab6fa80f-dae8-4e93-b4c3-6fd7474fa0a4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1363 microversion: 2.1 time: 0.442476 Nov 02 12:31:17.986246 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 118/247] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:17 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1363 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:18.082621 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.083679 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.119536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.120068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.120519 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.121245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.126009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.126793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.241866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.242905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.270661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.271922 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.278722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.283104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.286024 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.287843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.385946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.411917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-16fa4698-7df0-4c4c-94f2-9baa0e41af0e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.333951 Nov 02 12:31:18.415380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 130/248] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:18.569341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:18.570785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:18.599753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.600866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.602082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.603765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:18.604810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:18.606051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:18.652722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.680143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3e732f6c-0042-4011-ac7b-f5d967001c81 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1313 microversion: 2.1 time: 0.451615 Nov 02 12:31:18.680777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 119/249] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1313 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:18.834147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.845718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.847566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:18.849454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-19edd915-4011-43da-a137-c59224601b27 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.290106 Nov 02 12:31:18.850367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 131/250] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:18 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:19.031613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.032163 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.043183 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.044059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.044848 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.055487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.056680 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.057525 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.404261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.414471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1f439265-d91c-42b8-aeb7-24f6dc0b64a9 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1550 microversion: 2.1 time: 0.387673 Nov 02 12:31:19.416276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 120/251] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1550 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:19.439294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.440715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.447961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.448199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.448674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.449016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.449635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.450513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.451147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.451730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.465353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.465353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.465353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.465353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.465851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.465851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.633480 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-55e1ff0e-ee89-440f-b3e3-558f959373ad tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.199040 Nov 02 12:31:19.643111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 132/252] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-interface => generated 285 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:19.713904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.714904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.727997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.730445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.738258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.741584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.754275 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:19.759101 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.759642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.765937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aded615a-e642-496e-a0b1-119168137303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.324142 Nov 02 12:31:19.772538 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 121/253] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:19.885695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:19.886670 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:19.905291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.906298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.907187 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:19.908324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:19.909051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:19.909682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.336779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.359939 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.361617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.367730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5cb9db78-882e-40c5-92a2-be2d9b06e51d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.485932 Nov 02 12:31:20.368608 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 122/254] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:20.791884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:20.792498 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:20.820398 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.831160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.831691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.836336 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:20.836863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:20.837366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:20.881686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:20.899578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7d5c2f73-839c-4f78-9a17-4130ab410ffc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1497 microversion: 2.1 time: 1.183351 Nov 02 12:31:20.909056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 133/255] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:19 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1497 bytes in 1193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:21.217683 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "name": "network-vif-plugged", "status": "completed", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:21.258129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.258602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.262503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.319606 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] Creating event network-vif-plugged:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:31:21.337192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-cc839942-63b8-4cc4-87b9-9a0ad1290296 req-c28ec395-db55-4e15-a985-32534ffa8075 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.123084 Nov 02 12:31:21.338643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 134/256] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:21.418094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.418884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.437955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.439364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.441165 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.444841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.445706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.447116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.740196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.767942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f008d171-801c-4f5d-9489-b444255c196a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.980085 Nov 02 12:31:21.781095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 123/257] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:20 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:21.834502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:21.835974 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:21.842339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.843867 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.844752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.845669 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.846653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:21.847354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:21.847984 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:21.855466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.858324 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:21.864224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b4f4fcb6-bbf8-408c-b2e1-3d1070451a43 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.452169 Nov 02 12:31:21.865670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 135/258] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:21 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:21.889837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:22.046908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6598d389-b56d-4a60-a047-6cb101b7df4e tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "DELETE /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 204 len: 0 microversion: 2.1 time: 0.215780 Nov 02 12:31:22.047499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 124/259] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:21 2022] DELETE /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:31:22.061327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.066386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.082868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.085114 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.086259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.089646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.091140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.092655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.237549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:22.483266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:22.495845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a61dffd-0fdd-4526-a92f-2762d4884f1d tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1503 microversion: 2.1 time: 0.442116 Nov 02 12:31:22.496854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 136/260] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1503 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:22.802233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.804129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.819996 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.821728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.823395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.825304 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.826307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.827251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.912015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:22.913348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:22.925345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.927994 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.930907 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:22.932205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:22.932959 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:22.937087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.041769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.051621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1042fda-4f91-48fa-8323-e7053589e2dd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.257077 Nov 02 12:31:23.053249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 125/261] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:23.528715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:23.530248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:23.543311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.547221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.549162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.551472 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.553283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.553955 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.554782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.568267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.569878 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:23.571248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d8745eb6-43da-48bb-8637-b0de9544c2ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.663986 Nov 02 12:31:23.585739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 137/262] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:22 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:23.596857 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e473906-98d3-4493-8449-d57838bdae8f", "tag": "c5761531-577c-4309-a7db-9bb6acfee9dc"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:23.607467 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:23.608200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:23.608931 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:23.638935 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] Creating event network-changed:c5761531-577c-4309-a7db-9bb6acfee9dc for instance 4e473906-98d3-4493-8449-d57838bdae8f on hv-cinder-86327 Nov 02 12:31:23.649860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-1590640b-94c3-4478-9830-e287cb77ec67 req-2fedc4ac-811f-4a0d-9761-eb1fa9dc33d2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062498 Nov 02 12:31:23.650944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 138/263] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:24.108779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:24.110237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:24.139244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.139801 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.140322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.141215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.141848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.155940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.319144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.339337 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df2ad4fa-7bd3-480c-93e1-feb359f3b7f6 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1503 microversion: 2.1 time: 0.810328 Nov 02 12:31:24.353048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 126/264] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:23 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1503 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:24.609535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:24.611535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:24.626566 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.627899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.629263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.631684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:24.633715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:24.635518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:24.902161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:24.912580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-42580ce2-138b-433b-8a59-9d32c83c7458 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.835489 Nov 02 12:31:24.917922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 139/265] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:24 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:25.313381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.323439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.330819 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.332207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6dca256c-81f8-4e7b-93ce-91629fb1da07 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.735944 Nov 02 12:31:25.337706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 127/266] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:24 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:25.385903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.386562 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.404216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.413526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.414029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.414847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.415332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.415742 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.656748 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:25.670196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cbf32391-5d98-4fc1-907e-8160fbbbd664 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1461 microversion: 2.1 time: 0.288527 Nov 02 12:31:25.674093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 140/267] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1461 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:25.686150 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a83e4a2-16c2-4753-9307-9de44a3f430f", "name": "network-vif-deleted", "tag": "98b3c8ba-be36-40d6-85e4-1560f5301886"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:25.720555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.730722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.733401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.758307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] Creating event network-vif-deleted:98b3c8ba-be36-40d6-85e4-1560f5301886 for instance 2a83e4a2-16c2-4753-9307-9de44a3f430f on hv-cinder-86327 Nov 02 12:31:25.784325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-6fa99390-83f2-47e2-8f4a-266d90ff904a req-2c08376b-5063-44ef-bf03-3449804d8cfa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.101863 Nov 02 12:31:25.785339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 128/268] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:25.948793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:25.950154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:25.991572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.994109 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:25.995793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:25.998877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:25.999551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.000684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.374411 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.375281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.397772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.412658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.428140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e1b1ffe7-e6a5-4de0-9417-63de5142fc14 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.483474 Nov 02 12:31:26.429455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 141/269] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:25 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:26.439961 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.441461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.443401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.446178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.446951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.702716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:26.703164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:26.728533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.733790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.736167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.742144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.746504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.749743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.846316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.863572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.865917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:26.866086 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.867142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-06fe375c-b5de-4928-bfbd-28655a5914ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.501753 Nov 02 12:31:26.868042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 129/270] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:26.868644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:26.870553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:26.871218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lazy-loading 'fault' on Instance uuid 2a83e4a2-16c2-4753-9307-9de44a3f430f {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:26.876624 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:26.949443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:26.973047 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cf573404-22d9-4921-8b66-da5a9ac38041 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 200 len: 1303 microversion: 2.1 time: 0.274905 Nov 02 12:31:26.980336 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 142/271] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:26 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 1303 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:27.455977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.460402 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:27.479544 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.480603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.481624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.482714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.483457 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.484131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.676776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:27.686526 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-70a58cbb-4436-4a8d-a520-ce3e4f19bd19 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.236389 Nov 02 12:31:27.708833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 130/272] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:27.900514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:27.901292 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:27.908285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.908936 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.909516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:27.910607 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:27.911207 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:27.911734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.022692 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:28.023310 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 2a83e4a2-16c2-4753-9307-9de44a3f430f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:28.032186 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.033168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.033885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.035395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.036224 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.036844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.070937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] HTTP exception thrown: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Request method failure captured: Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f HTTP/1.1 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmL3bP3TssRXKwKPw0e8-1oktjd83sUZXOzTHbBgoarnhCjFYUx18z5BbZxtP9CGclPU4qUMbdATFkMPZ3_zKEqfPWA6RHLHnfEmPAPX6IuKCkeUWh-gsL_5lS6_cxq3QrSYt8cxx9m6ZHCkggbJIAxP_gEZWrorpM_sOGOOM3btSD8 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 8de43ea57f2b44229359e179314b2d15 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:31:28.076094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8de43ea57f2b44229359e179314b2d15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 8de43ea57f2b44229359e179314b2d15 Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesActionsTest-1635631239-project Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 6c07346fbdc44eda9b057abc0fcd209a Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesActionsTest-1635631239-project Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. Nov 02 12:31:28.077887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '2a83e4a2-16c2-4753-9307-9de44a3f430f'} Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:28.078840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. Nov 02 12:31:28.080323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:28.084156 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Returning 404 to user: Instance 2a83e4a2-16c2-4753-9307-9de44a3f430f could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:28.085408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-12449931-0397-45d4-82ee-986c4d1ce784 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f" status: 404 len: 111 microversion: 2.1 time: 0.067188 Nov 02 12:31:28.089382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 131/273] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:28 2022] GET /compute/v2.1/servers/2a83e4a2-16c2-4753-9307-9de44a3f430f => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:28.136339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:28.150778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:28.152632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:28.154345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e62a76eb-591a-4b46-be79-f5a837627a74 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.259437 Nov 02 12:31:28.166850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 143/274] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:27 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:28.299290 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1529944900", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "networks": [{"uuid": "d62e064f-fe22-410f-9e2a-c431b4b312b5"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:28.724403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:28.725137 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:28.731996 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] validate_networks() for [('d62e064f-fe22-410f-9e2a-c431b4b312b5', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:28.735650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.738208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.739003 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.740535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:28.741953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:28.743015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:28.992756 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.005770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-32564953-cd2a-4879-aa86-4d633ba49ea1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.285154 Nov 02 12:31:29.008081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 144/275] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:28 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:29.182608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.183327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.196972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.198026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.198649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.199408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.199849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.200275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.432885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.445137 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.446950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.448197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6e99db47-c784-4b52-8884-73f2430f9eeb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.269692 Nov 02 12:31:29.448826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 145/276] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:29.605308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:29.605967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:29.606647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:29.607116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:29.607585 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:29.618307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.618869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.619546 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.620768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:29.621600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:29.622095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:29.642632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Getting quotas for project 8de43ea57f2b44229359e179314b2d15. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:29.647241 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Getting quotas for user 6c07346fbdc44eda9b057abc0fcd209a and project 8de43ea57f2b44229359e179314b2d15. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:29.663172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:29.666676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:29.722268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-94eb623f-f425-4cc6-b1a4-6f20657c4299 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.426924 Nov 02 12:31:29.723840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 132/277] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 1429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:29.734577 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e55ba739-3da1-4eb0-bccc-ff2a56c17043 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:29.735538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e55ba739-3da1-4eb0-bccc-ff2a56c17043 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:29.811554 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e55ba739-3da1-4eb0-bccc-ff2a56c17043 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:29.820512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e55ba739-3da1-4eb0-bccc-ff2a56c17043 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1214 microversion: 2.1 time: 0.089827 Nov 02 12:31:29.825145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 146/278] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:29 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1214 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:30.039670 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.042106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.066314 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.067225 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.069496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.071578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.072483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.073104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.294015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1534557371", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "networks": [{"uuid": "198d3999-966c-482d-951f-86abbbcd5ae3"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:30.322595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.325055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:30.335749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8ff2fcb4-de76-43fc-ac0b-c5e1850d0b46 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.301511 Nov 02 12:31:30.336435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 133/279] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:30.414118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] validate_networks() for [('198d3999-966c-482d-951f-86abbbcd5ae3', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:30.480652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.481659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.489962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.490493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.491539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.492222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.493549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.493549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.704118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.713637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.715389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.716720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2e4dd438-747e-448a-be81-403b3930e5fa tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.240319 Nov 02 12:31:30.733414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 134/280] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:30.843887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:30.845070 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:30.852685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.853356 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.853975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.855202 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:30.855831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:30.856408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:30.982190 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:30.995973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c5d7b306-f389-43eb-afa4-726a101031eb tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1218 microversion: 2.1 time: 0.155861 Nov 02 12:31:30.996721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 135/281] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:30 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1218 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:31.009153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:31.010340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:31.011442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:31.012643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:31.013411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:31.026267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.027209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.028087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.028945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.029609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.030036 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.049571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Getting quotas for project 64af2cf0e0a14b3ea92c2438baeeb900. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:31.054275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Getting quotas for user d655fb9352544adf8b3bac0cfa202d9e and project 64af2cf0e0a14b3ea92c2438baeeb900. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:31.068788 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:31.071183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:31.131348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d9ceca7-91b5-4080-9758-3695dc8a4012 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.846691 Nov 02 12:31:31.139025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 147/282] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:31.143662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0f8f3887-516d-4314-b941-a2dc5839b45d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.146831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0f8f3887-516d-4314-b941-a2dc5839b45d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.225790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0f8f3887-516d-4314-b941-a2dc5839b45d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.234965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0f8f3887-516d-4314-b941-a2dc5839b45d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1219 microversion: 2.1 time: 0.094631 Nov 02 12:31:31.249108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 136/283] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:31.370716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.373445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.387284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.388092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.390146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.391105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.391569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.393395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.636479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:31.656905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d7fdbe64-6c97-438a-93ac-e0d4d1c6f0ba tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1500 microversion: 2.1 time: 0.297340 Nov 02 12:31:31.657941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 148/284] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1500 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:31.686516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eac46e73-0348-4bbc-8807-a093c4ea6453"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:31.689951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.700986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.701666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.702188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.703062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.703844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.704349 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.733298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] HTTP exception thrown: Cannot 'attach_volume' instance 3fc268ed-bf55-4bb7-a64b-66e569798119 while it is in vm_state rescued Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Request method failure captured: Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/os-volume_attachments HTTP/1.1 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 74 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKZnW8x3KSJFcsvcZjFTbd7Fbs_YppMYEpFh43nUxOdEojqzUzC551yaMAYnRscT9N5AXqoUygfBN3itwprc-l3gH6g-a-s1ILC4w9jlR7yatBHg-X7K5E8DAvMfhsu5CiRVxx_V6ylfFGdbPevnUFf1cT3KFx4670yeolY7Ri2ZyU Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:31:31.735011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 7c5ccd8c99934f60b4ca26c4990b7412 Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {"volumeAttachment": {"volumeId": "eac46e73-0348-4bbc-8807-a093c4ea6453"}} Nov 02 12:31:31.738147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Cannot 'attach_volume' instance 3fc268ed-bf55-4bb7-a64b-66e569798119 while it is in vm_state rescued Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'server_id': '3fc268ed-bf55-4bb7-a64b-66e569798119', 'body': {'volumeAttachment': {'volumeId': 'eac46e73-0348-4bbc-8807-a093c4ea6453'}}} Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 in vm_state rescued. Cannot attach_volume while the instance is in this state. Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:31.738960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 3fc268ed-bf55-4bb7-a64b-66e569798119 while it is in vm_state rescued Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:31.740139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 3fc268ed-bf55-4bb7-a64b-66e569798119 while it is in vm_state rescued Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Returning 409 to user: Cannot 'attach_volume' instance 3fc268ed-bf55-4bb7-a64b-66e569798119 while it is in vm_state rescued {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dfcad911-baf9-417e-b83e-d6258316e098 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.057495 Nov 02 12:31:31.741269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 137/285] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:31:31 2022] POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/os-volume_attachments => generated 152 bytes in 59 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Nov 02 12:31:31.746152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.746764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.753289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.754045 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.755014 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.755721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.756174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.756594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.758098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:31.759465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.775601 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.776487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.777550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.778270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.778728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.779168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.869110 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fcb74a6b-02d5-49c1-992f-794dd171be04 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/action" status: 202 len: 0 microversion: 2.1 time: 0.117968 Nov 02 12:31:31.874290 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 138/286] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:31:31 2022] POST /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:31:31.881172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:31.882035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:31.892717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.893243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.893678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:31.894403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:31.894944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:31.895321 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.022899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.032750 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.034318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.035626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1061cc3-449d-4815-9604-3acc801af690 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.293714 Nov 02 12:31:32.057443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 149/287] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:32.062970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:32.063825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:32.073860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.074602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.075695 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.078161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.079712 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.080316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.173183 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.182445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-16bd3f47-9d5e-4980-8ed2-e8e79f8a2f5c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1508 microversion: 2.1 time: 0.306659 Nov 02 12:31:32.183524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 139/288] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:31 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1508 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:32.196286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.206140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c7499b95-c43a-44f0-aaba-fe6ddd48be47 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1266 microversion: 2.1 time: 0.147263 Nov 02 12:31:32.208244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 150/289] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:32 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:32.262590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:32.263281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:32.269978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.271280 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.271876 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.272732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:32.273526 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:32.274195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:32.343379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:32.351631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7c251887-8ec9-4dec-8796-7c6d30477a87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1215 microversion: 2.1 time: 0.094724 Nov 02 12:31:32.352188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 140/290] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:32 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1215 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:33.068069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.069526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.082849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.086572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.090715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.092253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.092966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.093670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.209083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.211231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.221978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.222851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.224406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.226279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.227334 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.229508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.263769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.277778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.279559 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.281047 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-027be750-a39d-4ed9-b785-c6dad1d3c992 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.220851 Nov 02 12:31:33.282996 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 151/291] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:33.293266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.294108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.307188 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.307998 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.308621 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.309705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.310571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.311379 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.396150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.408201 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2262a6df-1da3-42ed-8199-54c2356f1a5f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1272 microversion: 2.1 time: 0.123933 Nov 02 12:31:33.409264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 152/292] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1272 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:33.420943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:33.421706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:33.427951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.428769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.429597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.430771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:33.431428 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:33.432050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:33.530349 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.539839 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:33.544601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2246f56a-bb4d-4a94-aec6-10abb58013a5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1271 microversion: 2.1 time: 0.133547 Nov 02 12:31:33.545614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 153/293] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1271 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:33.560741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2d7ea5df-27c5-41a0-8258-0d6cc8785a40 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1508 microversion: 2.1 time: 0.357158 Nov 02 12:31:33.576570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 141/294] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:33 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1508 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:34.311443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.312052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.319243 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.319731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.320158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.320869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.321350 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.321769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.434462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.435169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.451194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.451688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.452121 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.452829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.453483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.454062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.515235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.534414 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.562738 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.567130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f182f087-0121-44d8-96de-3e2430a1e692 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.259107 Nov 02 12:31:34.571657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 154/295] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:34.577281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2043937003", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1697924631", "security_groups": [{"name": "tempest-secgroup-smoke-711075700"}], "networks": [{"uuid": "6edbe81a-ad8c-4936-a044-e7c71fdd584a"}], "block_device_mapping_v2": [{"uuid": "bc0755d7-6e27-491d-87d2-ec63e06df83a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:34.625697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.635376 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74cef69a-22f8-4115-b662-469562a6d575 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.205492 Nov 02 12:31:34.636262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 142/296] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:34.642874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.643654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.661285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.662137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.662762 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.663729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.664421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.665061 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.738634 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.742653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] validate_networks() for [('6edbe81a-ad8c-4936-a044-e7c71fdd584a', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:34.749115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4ce41557-36a2-4925-b112-69bc89826b44 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1277 microversion: 2.1 time: 0.110896 Nov 02 12:31:34.765027 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 143/297] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1277 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:34.767221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:34.767221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:34.774476 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.774958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.775519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.776221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:34.776672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:34.777134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:34.923960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:34.932359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-40d452b9-aa85-4cbd-b479-152daa5ab05e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1508 microversion: 2.1 time: 0.173619 Nov 02 12:31:34.933282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 144/298] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:34 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1508 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:35.210702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:35.211216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:35.211759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:35.212236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:35.212713 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:35.239432 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.239962 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.240354 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.244753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.244753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.244753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.275567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Getting quotas for project 620e39db57f34948b5450e5b90c984cb. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:35.280267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Getting quotas for user 20a4049d2b2b474a8a830d0702b9b1fa and project 620e39db57f34948b5450e5b90c984cb. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:35.379342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:35.382552 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bc0755d7-6e27-491d-87d2-ec63e06df83a',volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:35.564495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e78119b8-3247-4971-b1f5-4acb318d2d59 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.991224 Nov 02 12:31:35.565813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 155/299] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:34 2022] POST /compute/v2.1/servers => generated 405 bytes in 993 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:35.588871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-750983ba-0626-46ec-ab2a-fbe013e1a5a9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.589746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-750983ba-0626-46ec-ab2a-fbe013e1a5a9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.603984 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.605545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.614421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.615173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.615789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.616780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.617780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.618375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.710846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-750983ba-0626-46ec-ab2a-fbe013e1a5a9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.724726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-750983ba-0626-46ec-ab2a-fbe013e1a5a9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1089 microversion: 2.1 time: 0.147151 Nov 02 12:31:35.726828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 145/300] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1089 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:35.733854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.735759 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.744675 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:35.760122 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.761224 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.763379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.765320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.766264 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.767152 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.826839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.840227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.841519 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:35.842851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c08182d1-20b3-498e-899f-811417c8772e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1739 microversion: 2.20 time: 0.246779 Nov 02 12:31:35.843740 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 156/301] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:35.855333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:35.857096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:35.860980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:35.867851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.868632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.869493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:35.870546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:35.870546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:35.871147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.008252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.019402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1b949daf-50a7-4909-ae44-cf3c6cb609d6 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1277 microversion: 2.1 time: 0.174144 Nov 02 12:31:36.034675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 157/302] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1277 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:36.044896 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.045546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.053686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.054176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.054823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.055541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.055996 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.056581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.105387 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.114786 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc2cda6b-f54e-4dbf-815d-e967e2924a1b tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.386623 Nov 02 12:31:36.115876 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 146/303] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:35 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:36.215673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:36.223932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-42cb3374-c45b-4c69-808b-7d8a76aa036b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1514 microversion: 2.1 time: 0.187695 Nov 02 12:31:36.224503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 158/304] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1514 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:36.754371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.755085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.763414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.763912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.764374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.765412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.766029 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.766442 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.873328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:36.874337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:36.887129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.887622 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.888043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:36.888770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:36.889253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:36.889669 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.043317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.052808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.054248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.055437 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bfbd4a98-0661-4e18-b71e-61ca9f770ef5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1721 microversion: 2.20 time: 0.187880 Nov 02 12:31:37.055992 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 159/305] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:37.061868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.062752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.069116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.070028 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.070668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.071975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.072809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.073608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.079699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.088776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e61046e9-c204-48b4-b609-5be659cdbb5f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1187 microversion: 2.1 time: 0.338913 Nov 02 12:31:37.089403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 147/306] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:36 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1187 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:37.143467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:37.144447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:37.151544 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.152431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.153086 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.153791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.154405 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.154811 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.240574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.248882 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fcec734a-b65b-4b45-9956-fc3790242d67 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.190568 Nov 02 12:31:37.249439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 160/307] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:37.254537 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b440d0f-2b65-4d28-b859-93348307b26d", "tag": "97b6d107-5049-455a-99ff-3f7eb13dea30"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:37.265447 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:37.265917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:37.266344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:37.282222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] Creating event network-changed:97b6d107-5049-455a-99ff-3f7eb13dea30 for instance 6b440d0f-2b65-4d28-b859-93348307b26d on hv-cinder-86327 Nov 02 12:31:37.288685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-7cb3e4c6-4d4e-4d91-beb4-d7c4712554bf req-ff438fe1-e8d9-4cfb-bffb-afe7bbf4d87b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037399 Nov 02 12:31:37.289260 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 161/308] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:37.556505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:37.564735 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1fd016db-16a2-4c63-acc3-da7c537b0d2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.427655 Nov 02 12:31:37.565499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 148/309] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:37 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:37.699609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f280c2f2-4540-44d7-a363-6b82ef9d80f2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: .version_select at 0x7faf06b5d790>, body: {"keypair": {"name": "tempest-keypair-237641760", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGnkkEhPHGjS2WedbMuXRo6sx02/yL5iBwzzAkEle9SMBKrUR/BbcWw5BxP1Thceexc7DWt9iqVnS/QluyS4cmG8r5/auHOk9sNXJASveVKhlmVhb+890YTZ3OqZo9clLw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:37.717092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-f280c2f2-4540-44d7-a363-6b82ef9d80f2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:37.722271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-f280c2f2-4540-44d7-a363-6b82ef9d80f2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for user 7c5ccd8c99934f60b4ca26c4990b7412 and project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:37.754760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f280c2f2-4540-44d7-a363-6b82ef9d80f2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.061663 Nov 02 12:31:37.755604 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 162/310] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:31:37 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:38.082529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.082998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.092446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.092914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.093386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.094111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.094564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.094985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.114015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.114753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.129301 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.129804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.130922 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.131816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.132426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.133051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.136589 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:38.287493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.302490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-61a0a88b-d055-4473-8c63-da691536360c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1205 microversion: 2.1 time: 0.193758 Nov 02 12:31:38.304358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 163/311] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1205 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:38.320687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.322871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.344953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.346540 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.347703 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.348707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.349210 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.349642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.526442 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.540820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.543999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.549077 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4bb31880-b209-43ed-93d5-2eba723a52ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1721 microversion: 2.20 time: 0.470117 Nov 02 12:31:38.551478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 149/312] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1721 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:38.592406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:38.593373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:38.601399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.602033 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.602569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.603381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:38.604013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:38.604653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:38.723978 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.750063 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5c2acfbd-cd2e-4324-b22c-1c87f2bfb20b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.443309 Nov 02 12:31:38.765686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 164/313] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:38.871558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:38.882861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5446a05e-0b09-421b-8896-cdee3f130921 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.297494 Nov 02 12:31:38.883610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 150/314] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:38 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:39.331235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d540597-ace2-4cfb-841d-d020330f5e9d", "tag": "a2cd9294-40e8-4c72-92e4-4a022321affe"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:39.333587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.335142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.344691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.346418 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.347180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.349167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.349966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.350541 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.351384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.352556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.353638 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.383652 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] Creating event network-changed:a2cd9294-40e8-4c72-92e4-4a022321affe for instance 8d540597-ace2-4cfb-841d-d020330f5e9d on hv-cinder-86327 Nov 02 12:31:39.398943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-fbacbc60-02c7-490e-88b2-3648c2c3f463 req-1f082758-0ad9-46d2-b166-44150ee17f59 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076137 Nov 02 12:31:39.400130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 165/315] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:39.580733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.582023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.597822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.598685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.599706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.601252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.602076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.602794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.622694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.630140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:39.636821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:39.642921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0cf3a8fc-ffdc-423b-8e0d-a6caed7d933e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.314849 Nov 02 12:31:39.643919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 151/316] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:39.795108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.795932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.809055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.810086 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.811094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.812488 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.813632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.814212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.848936 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.864127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.866995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:39.869103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a506a067-70f2-42bd-9a2f-957f4570e922 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1721 microversion: 2.20 time: 0.295792 Nov 02 12:31:39.870375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 166/317] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1721 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:39.911453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:39.913093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:39.933797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.935971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.936894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:39.938355 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:39.939285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:39.940136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.299601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:40.314726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-12c315f4-db5d-4468-89d1-6897bc41aed5 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.410888 Nov 02 12:31:40.315956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 167/318] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:40.641702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:40.657694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6703e980-216a-489a-8336-0132b6682b78 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.869070 Nov 02 12:31:40.669036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 152/319] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:39 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:40.681821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:40.683087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:40.692192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.693228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.694155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.695248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.695852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.696281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.918899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:40.920355 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:40.932679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.933970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.935305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:40.936863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:40.937973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:40.938948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.054120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.084581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8f8e6a17-bf92-467d-b84e-892836fafb36 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.406220 Nov 02 12:31:41.087358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 168/320] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:40 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:41.114924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "name": "network-vif-unplugged", "status": "completed", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:41.150123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.150997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.151839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.191102 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.compute.server_external_events [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] Unable to find a host for instance c684f91d-7d77-4303-99ad-d73b293539a4. Dropping event network-vif-unplugged {{(pid=120739) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:31:41.196731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-672ecf1e-efcd-4bde-b209-b092d905d347 req-70b6d2f2-c8db-41a2-9c0b-a2dd3cccffeb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.097960 Nov 02 12:31:41.202366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 169/321] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 108 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Nov 02 12:31:41.219159 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:41.251453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.252417 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.253060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.266458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] Creating event network-changed:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:31:41.271819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-222a3def-666e-4282-ade8-61491f5f987e req-6aa425e3-43fe-4d1f-b8e0-4712265faf96 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057500 Nov 02 12:31:41.272445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 170/322] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:41.345890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:41.347360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:41.359859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.362620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.364394 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.365615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.366871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.367883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.648150 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.665969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.669586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.672247 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca76c6d2-9c73-48fb-a163-c29b14ac7943 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1724 microversion: 2.20 time: 0.762690 Nov 02 12:31:41.685044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 153/323] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:40 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1724 bytes in 766 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:41.685044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-794698289", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d036ebb3-3fc9-46ee-88bb-f55457c5a308"}], "security_groups": [{"name": "tempest-securitygroup--1951174452"}], "key_name": "tempest-keypair-237641760", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:41.720685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:41.739462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41b546d8-27c8-44aa-9c86-da4c4521fd15 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.401190 Nov 02 12:31:41.749146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 171/324] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:41 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:41.763048 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:41.764786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:41.778010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.778854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.779567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.781107 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:41.782133 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:41.782917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:41.887578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] validate_networks() for [('d036ebb3-3fc9-46ee-88bb-f55457c5a308', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:31:42.132136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.141904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-032bf15c-8375-44f6-9f10-7c9522c349fb tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.388035 Nov 02 12:31:42.142780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 172/325] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:41 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:42.148882 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23896349-7ff8-4dd7-91d2-853c7e855fab"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:42.151866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.157928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.158616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.159129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.160947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.162103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.163024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.432932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:31:42.433710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:31:42.435153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:31:42.436212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:31:42.437071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:31:42.455771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.456620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.457510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.458881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.459718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.460530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.497649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:31:42.506749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Getting quotas for user 7c5ccd8c99934f60b4ca26c4990b7412 and project 3dfb62f918dd41aea2e6d49286476dd0. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:31:42.538743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:31:42.543796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:31:42.654838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bda1983a-43c7-439e-adf4-c1d36d89a1c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.979928 Nov 02 12:31:42.656225 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 154/326] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:31:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:31:42.656495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5a671e38-7fa8-494d-b67f-91b03087f2ac tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.512134 Nov 02 12:31:42.667439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 173/327] 10.222.0.85 () {62 vars in 1364 bytes} [Wed Nov 2 12:31:42 2022] POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:31:42.669194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.670553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.678942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5b9dd57-5ac3-41aa-bdde-7c5fefc72454 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.681380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5b9dd57-5ac3-41aa-bdde-7c5fefc72454 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.683900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.685052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.685805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.687766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.687936 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.688671 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.854930 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5b9dd57-5ac3-41aa-bdde-7c5fefc72454 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:42.866500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5b9dd57-5ac3-41aa-bdde-7c5fefc72454 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1244 microversion: 2.1 time: 0.197095 Nov 02 12:31:42.867098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 174/328] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1244 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:42.881033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:42.881033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:42.894361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.894985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.896029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:42.896898 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:42.897396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:42.897831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.033776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.050277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7cec76d6-a107-4c48-b82b-c8509f5af677 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.392096 Nov 02 12:31:43.057391 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 155/329] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:43.068010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:43.070103 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.084471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.085388 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.086196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.088539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.089597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.090970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.117643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.139804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-78df5b59-5b64-4e5a-828c-93611ab9389f tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.268642 Nov 02 12:31:43.140803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 175/330] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:42 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:43.177998 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.179159 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.193512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.194413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.195097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.196103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.196788 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.197510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.458287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120740) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:31:43.593970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e8367ce9-263e-4ddc-b098-d1079e63957d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/action" status: 202 len: 0 microversion: 2.20 time: 0.534143 Nov 02 12:31:43.594587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 156/331] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Nov 2 12:31:43 2022] POST /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/action => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:31:43.617569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.619873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.642618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.645610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.650480 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.652347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.655010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.655956 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.728013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.740381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d1e32340-7113-4786-b52d-e04e7cbd6d87 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.566700 Nov 02 12:31:43.753728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 176/332] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:43 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:43.870260 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.881157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.882636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.883837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8e336d5a-68d8-4063-98e4-9ab67848987f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1750 microversion: 2.20 time: 0.284122 Nov 02 12:31:43.884401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 157/333] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:43 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1750 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:43.893059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:43.895210 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:43.902535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.904778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.905794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.906792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:43.907388 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:43.907960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:43.983123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:43.994643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-31877752-df28-4578-ab34-1a8a3dacdbd1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1248 microversion: 2.1 time: 0.106169 Nov 02 12:31:43.995740 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 177/334] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:43 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1248 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:44.078098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.079008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:44.087185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.088051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.088833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.090175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.090992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.091792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.165807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.166426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:44.173025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.173599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.174038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.174688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.175144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.175581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.303830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.325691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-99805dda-246a-446f-a195-f14452f0ad8f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.252469 Nov 02 12:31:44.351056 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 158/335] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:44.460082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:44.477706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fe74c192-1561-4d6e-a063-8758ca5f8071 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.316177 Nov 02 12:31:44.478868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 178/336] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:44.770758 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.772327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:44.785205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.786174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.786953 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.788653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.789434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.790297 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.922833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:44.924758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:44.946216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.947816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.949072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:44.952281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:44.953359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:44.954204 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.110096 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.126091 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-82843829-89d0-4d06-b703-9e6417e40a01 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.362076 Nov 02 12:31:45.141210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 159/337] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:45.141210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:45.141210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:45.149104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.149984 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.150658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.151830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.152606 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.153648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.250667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:45.260834 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.283149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.286812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.291052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1c0e057c-783c-49ad-8659-c2b17945217f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1750 microversion: 2.20 time: 0.380885 Nov 02 12:31:45.292262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 179/338] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:44 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1750 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:45.326481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.346481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d16c1991-aaee-4129-842a-c4245135bb32 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1296 microversion: 2.1 time: 0.216734 Nov 02 12:31:45.348080 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 160/339] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:45 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1296 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:45.360675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b440d0f-2b65-4d28-b859-93348307b26d", "name": "network-vif-plugged", "status": "completed", "tag": "97b6d107-5049-455a-99ff-3f7eb13dea30"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:45.388554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:45.389964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:45.402437 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.403253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.403397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.403863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.404474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.405976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.407278 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.407436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.408200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.418027 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:45.446059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] Creating event network-vif-plugged:97b6d107-5049-455a-99ff-3f7eb13dea30 for instance 6b440d0f-2b65-4d28-b859-93348307b26d on hv-cinder-86327 Nov 02 12:31:45.457092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-97b20cec-74e7-46f3-a599-5b200d2ba6ac req-81cf029e-f1d2-4b24-8e36-f592b5ae8937 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149349 Nov 02 12:31:45.460164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 180/340] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:45.508363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:45.511828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:45.527194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.540436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.541225 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.542157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:45.542628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:45.543079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:45.808612 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.829322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ae091dd1-9eed-4e48-a1a7-986334c732da tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.458293 Nov 02 12:31:45.848131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 161/341] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:45 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:45.923149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:45.934187 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-cdeb9544-25b5-4c8d-aafc-c4348526bc2c tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.436639 Nov 02 12:31:45.934778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 181/342] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:45 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:46.156247 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.156873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:46.164141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.164617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.165159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.165897 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.166359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.166804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.350679 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.351303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:46.361692 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.368781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.369361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.370118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.370645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.371148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.371643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.374515 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c1aa6e0e-03c8-4572-8a58-bfe4b5712037 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.222243 Nov 02 12:31:46.375484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 162/343] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:46.383088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.383967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:46.393820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.395263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.396173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.397008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.397810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.398748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.501214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.510628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f40ebc4b-a5d1-4231-b747-34375a91575e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1302 microversion: 2.1 time: 0.131428 Nov 02 12:31:46.511405 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 163/344] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1302 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:46.609215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.620363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.622362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:46.623877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aa41e847-3cb8-4028-a5a6-3740ec642584 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1752 microversion: 2.20 time: 0.279198 Nov 02 12:31:46.624787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 182/345] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1752 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:46.858784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.861063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:46.874329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.875589 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.877647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.879425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:46.880455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:46.883876 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:46.997031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:46.998664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.024913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.026574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.027639 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.029321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.030651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.031965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.205198 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.214903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-55783062-5861-4dd9-b06f-135264189231 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.363805 Nov 02 12:31:47.229683 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 164/346] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:47.351306 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.366405 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-90baf5ef-4a2e-4295-88ea-347c240f7805 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1314 microversion: 2.1 time: 0.410186 Nov 02 12:31:47.367494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 183/347] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:46 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:47.398671 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.399293 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.405853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.406341 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.406770 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.407495 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.407948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.408372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.547951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.549171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.560381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.562230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.564385 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.567594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.569150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.570789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.633668 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.662933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1de81f2a-b3ea-4220-a0fb-ec4bda61c871 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.268187 Nov 02 12:31:47.663986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 165/348] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:47 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:47.674826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d540597-ace2-4cfb-841d-d020330f5e9d", "name": "network-vif-plugged", "status": "completed", "tag": "a2cd9294-40e8-4c72-92e4-4a022321affe"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:47.702112 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.703397 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.704262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.746144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] Creating event network-vif-plugged:a2cd9294-40e8-4c72-92e4-4a022321affe for instance 8d540597-ace2-4cfb-841d-d020330f5e9d on hv-cinder-86327 Nov 02 12:31:47.756161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-30fbd7c5-bd8d-434e-896b-fb110a561567 req-d94dd474-9deb-4e30-ac7a-562b8f097a0e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089025 Nov 02 12:31:47.757195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 166/349] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:47.770708 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:47.772081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:47.787289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.787954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.788524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.789962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:47.790734 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:47.791261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:47.871747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:47.890389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4dbacbab-7b0e-4851-ac94-89a7c078c9a5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.353947 Nov 02 12:31:47.897493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 184/350] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:47 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:47.979876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:48.001734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.004216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.005381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.045993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] Creating event network-changed:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:31:48.060393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-8c6efaea-87e9-4293-b286-c5d080550154 req-74e64d20-407b-4e1e-9783-0e90d184e5fc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087110 Nov 02 12:31:48.063646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 185/351] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:48.135034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.144507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.146044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.147258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-38470a9f-39c7-467e-96ee-98b0c0f96167 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.387484 Nov 02 12:31:48.147833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 167/352] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:47 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:48.240587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.241368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.249260 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.249797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.250283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.251057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.251528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.252048 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.392574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.393507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.401686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.402518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.403185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.404149 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.404805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.405402 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.511430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.521368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-139dbfe8-b65f-4ec1-9764-0fd49cf42fd5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.285304 Nov 02 12:31:48.521996 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 186/353] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:48.689231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.690142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.697771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.698423 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.698934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.699818 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.700362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.700793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.731738 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.734516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:48.744020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-560317fb-5b31-4046-bf70-e9ba33940de3 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1499 microversion: 2.1 time: 0.356726 Nov 02 12:31:48.744798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 168/354] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1499 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:48.897407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:48.905676 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-79999699-4530-42ea-b8a3-351b3134c3cc tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.220758 Nov 02 12:31:48.906330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 187/355] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:48.950163 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:48.951162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:48.966007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.966007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.966007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:48.966007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:48.966659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:48.966842 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.153618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.162769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3ff4f79-633d-495b-ac9d-fcb1ea9786f7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.217635 Nov 02 12:31:49.163367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 169/356] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:48 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:49.175954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.176707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.182960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.183528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.183961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.184694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.185176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.185594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.327363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.328185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.341684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.342939 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.343800 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.345134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.345931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.346664 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.374171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.385289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:31:49.389634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.392638 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.395255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-484f8fc3-df89-42f9-88c0-4cebf2754da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.223020 Nov 02 12:31:49.396332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 188/357] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:49.506640 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6e43ba82-1ce5-4ac1-8890-3a3165cb00e8 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 204 len: 0 microversion: 2.1 time: 0.184014 Nov 02 12:31:49.508125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 170/358] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:31:49 2022] DELETE /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:31:49.523790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.524728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.535536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.535883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.538274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.539746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.540544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.541639 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.564628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.570153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.581212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.582570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.583403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.584679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.585315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.585834 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.759612 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.775317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-233f0371-7dad-445e-87b8-b30d4a904017 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1505 microversion: 2.1 time: 0.260540 Nov 02 12:31:49.776371 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 189/359] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1505 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:49.801146 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:49.813395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ed1cb044-3d14-425c-a3b9-2b0407cbdfb6 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.255622 Nov 02 12:31:49.814083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 171/360] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:49.930713 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:49.931713 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:49.938849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.939336 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.939768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:49.940477 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:49.940929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:49.941437 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.101333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.110379 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-10e9bfd5-5519-4348-9c85-550432958275 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.184158 Nov 02 12:31:50.111097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 190/361] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:49 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:50.192706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.193789 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.204756 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.205534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.206237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.208052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.208815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.209553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.365360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.374217 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-23a3bc05-c735-4f68-9563-74612ae87a3c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.190854 Nov 02 12:31:50.374878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 172/362] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:50.422414 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.423173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.429556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.430158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.430657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.431437 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.432002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.432542 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.611052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.627825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.631523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:50.633765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-489e546a-ce05-46f1-80ba-fef800660f9f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.214967 Nov 02 12:31:50.634805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 191/363] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:50.803551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.803940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.811436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.812033 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.812545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.813316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.813780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.814203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.838314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:50.839329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:50.852796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.854106 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.855188 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:50.856727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:50.857823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:50.858809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.021920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.038416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-76c4c412-7418-457f-8bf3-23814a2158e4 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1505 microversion: 2.1 time: 0.239736 Nov 02 12:31:51.038998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 173/364] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1505 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:51.084780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.094666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1f3a76ce-44d7-4e05-bfb8-263298143292 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.261905 Nov 02 12:31:51.095449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 192/365] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:50 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:51.138526 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.139580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.149047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.149870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.150609 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.151840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.152794 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.153780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.404775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.407401 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.420642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.421576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.422312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.423512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.426628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.427755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.494796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.504074 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-464b9114-5e66-45af-8cd9-df4369df7a6c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1319 microversion: 2.1 time: 0.371691 Nov 02 12:31:51.504726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 174/366] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1319 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:51.649722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.661690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-088fc8d1-a30e-409e-98fc-60eecedc219c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.265540 Nov 02 12:31:51.662594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 193/367] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:51.681631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:51.682721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:51.692619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.693873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.694407 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.695325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:51.696097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:51.696642 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:51.863774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.876886 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.878691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:51.879948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5d5fe4d7-e657-4e9c-b00e-9382108d3b92 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.203441 Nov 02 12:31:51.880762 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 175/368] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:51 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:52.066663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.067798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.077253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.077753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.078198 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.078934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.079398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.079832 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.125692 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.126763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.136130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.136964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.137627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.138582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.139182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.139709 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.254068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.262852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ad0f552-76e8-45d9-87c0-b5bf5515ec83 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1505 microversion: 2.1 time: 0.203545 Nov 02 12:31:52.263768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 194/369] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1505 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:52.364930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.375400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74cb67b5-7c99-47d7-851e-5f8d91c03177 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.257070 Nov 02 12:31:52.375985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 176/370] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:52.540209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.541976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.552884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.553781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.554535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.556083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.556894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.557680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.701343 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.702248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.704629 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:52.705476 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=16 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:52.712925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.713547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.714085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.714865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.715393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.715885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.855292 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.862384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=20 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:52.873928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-787d19fa-03c9-44c7-a07a-0f7a21ecfdde tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1507 microversion: 2.1 time: 0.340775 Nov 02 12:31:52.875413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 195/371] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1507 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:52.903639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:52.913619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:52.915630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:52.920675 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f72e339-d714-45ac-8a08-a7b4acc819b5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.223300 Nov 02 12:31:52.928629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.929835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.930974 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.933802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:52.936492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:52.937906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:52.954661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 177/372] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:53.290560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:53.291702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.308660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.311868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.317108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.327087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.330390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.338013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.465364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.502006 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.517411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.520618 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1243e921-731d-433f-8757-76f331e86bea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.614438 Nov 02 12:31:53.521661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 196/373] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:52 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:53.543823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:53.544806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:53.562684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.567179 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.576798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.578479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.579499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.580452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.739809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.756379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-411072cb-058b-467e-b892-b94c12da12fc tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1463 microversion: 2.1 time: 0.471648 Nov 02 12:31:53.757608 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 178/374] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:53 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1463 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:53.915060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b440d0f-2b65-4d28-b859-93348307b26d", "name": "network-vif-deleted", "tag": "97b6d107-5049-455a-99ff-3f7eb13dea30"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:53.933492 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:53.933974 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:53.934397 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:53.986871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:53.995158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] Creating event network-vif-deleted:97b6d107-5049-455a-99ff-3f7eb13dea30 for instance 6b440d0f-2b65-4d28-b859-93348307b26d on hv-cinder-86327 Nov 02 12:31:54.009372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-82584afd-7cdc-42c6-a5cf-24e6d059cd53 req-f7775298-0dce-455c-b01b-7bb32ea311c9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099120 Nov 02 12:31:54.013133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 179/375] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:31:54.019183 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:54.020314 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:54.026991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5d0794dd-4cc4-4713-bfaa-fc647637ae7f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.503171 Nov 02 12:31:54.042140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 197/376] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:53 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:54.045991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.046499 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.046960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.049182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.052422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.053214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.131581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "name": "network-vif-plugged", "status": "completed", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:54.149134 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.149876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.150408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.164464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:54.169296 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] Creating event network-vif-plugged:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:31:54.183812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-0db0af3c-fa93-45a4-afdc-cb5f17e6db3a req-2779cc0f-1ff6-4e61-bcf2-4876549172f8 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068971 Nov 02 12:31:54.187794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 198/377] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:54.582992 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:54.584387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:54.639821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.642086 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.643618 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.646504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.646504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.657832 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.891751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:54.905255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-799a481f-3512-4b0f-92bc-884cceafbba9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.890585 Nov 02 12:31:54.905849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 180/378] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:54 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:54.911079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:54.911692 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:54.918887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.919390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.920124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.921133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.921755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.922343 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.974631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:54.983741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:54.987061 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:54.988423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:54.989769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lazy-loading 'fault' on Instance uuid 6b440d0f-2b65-4d28-b859-93348307b26d {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:31:55.141693 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c07346fbdc44eda9b057abc0fcd209a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8de43ea57f2b44229359e179314b2d15', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.151702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9c4d0f68-311b-4792-b9e4-651f646b9365 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 200 len: 1304 microversion: 2.1 time: 0.244776 Nov 02 12:31:55.153189 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 181/379] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:54 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 1304 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:55.159585 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:55.160436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:55.167700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.168489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.168933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.169709 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.170166 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.170592 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.190632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.200975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.202473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.203675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-01ff3bdc-5a5e-4d51-ad70-bc12c4ce5fda tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.635724 Nov 02 12:31:55.204246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 199/380] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:54 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:55.417556 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:55.426537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e1717f60-8d70-4f0c-932c-809ea44a1858 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.272029 Nov 02 12:31:55.427130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 182/381] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:55 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:55.950370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:55.952386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:55.963107 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.963673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.964125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:55.965018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:55.965513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:55.965966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.211839 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:56.213112 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] [instance: 6b440d0f-2b65-4d28-b859-93348307b26d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.226849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.227982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.229024 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.229936 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.230479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.231089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.249561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] HTTP exception thrown: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Request method failure captured: Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d HTTP/1.1 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmL3bP3TssRXKwKPw0e8-1oktjd83sUZXOzTHbBgoarnhCjFYUx18z5BbZxtP9CGclPU4qUMbdATFkMPZ3_zKEqfPWA6RHLHnfEmPAPX6IuKCkeUWh-gsL_5lS6_cxq3QrSYt8cxx9m6ZHCkggbJIAxP_gEZWrorpM_sOGOOM3btSD8 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 8de43ea57f2b44229359e179314b2d15 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:31:56.251831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_8de43ea57f2b44229359e179314b2d15"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/8de43ea57f2b44229359e179314b2d15"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 8de43ea57f2b44229359e179314b2d15 Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesActionsTest-1635631239 Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesActionsTest-1635631239-project Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 6c07346fbdc44eda9b057abc0fcd209a Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesActionsTest-1635631239-project Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. Nov 02 12:31:56.254396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '6b440d0f-2b65-4d28-b859-93348307b26d'} Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:31:56.255613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. Nov 02 12:31:56.257656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:31:56.260903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] Returning 404 to user: Instance 6b440d0f-2b65-4d28-b859-93348307b26d could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:31:56.262472 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c73eb3b6-cb6a-4503-bedf-49e5ade4f9f1 tempest-VolumesActionsTest-1635631239 tempest-VolumesActionsTest-1635631239-project] 10.222.0.85 "GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d" status: 404 len: 111 microversion: 2.1 time: 0.061083 Nov 02 12:31:56.268314 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 183/382] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:56 2022] GET /compute/v2.1/servers/6b440d0f-2b65-4d28-b859-93348307b26d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:31:56.274641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "name": "network-vif-plugged", "status": "completed", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:31:56.292209 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.292941 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.293664 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.298202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:56.310205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] Creating event network-vif-plugged:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:31:56.312064 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-adefb6a5-fb37-4ebc-9c9c-76a90a0a3f08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.372366 Nov 02 12:31:56.312977 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 200/383] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:55 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:56.318068 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-9c78f684-b335-45b0-9e07-65448101ec2c req-e04f1d82-e96d-4129-9d9f-cdea651e2a34 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046882 Nov 02 12:31:56.319262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 184/384] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:31:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:31:56.325241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:56.326559 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.336435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:56.340950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.341768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.342364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.343286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.344005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.344629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.456049 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:56.459050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:56.488697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.494170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.494610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.495444 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:56.495966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:56.502778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:56.569393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:56.570245 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:31:56.608699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:56.610271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:56.611560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e61b364-4731-4fab-a8f0-f67f603efc25 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.297422 Nov 02 12:31:56.612421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 201/385] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:56 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:56.827627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:56.836242 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa530140-0ca6-4af1-a446-6eed83dbee7b tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.386977 Nov 02 12:31:56.837285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 185/386] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:56 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:57.342233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:57.343407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:57.372061 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.373568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.374700 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.376261 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.377205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.379218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.559958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:57.568954 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9783e5a6-c91d-449a-8519-a4999cb6513e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.235226 Nov 02 12:31:57.570637 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 202/387] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:57 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:57.638423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:57.639004 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:57.645362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.645846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.646273 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.646951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.647395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.647808 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.837543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:57.852393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:57.854281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:57.855761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2cafe75a-5a8a-45ca-9d41-da08b431f08f tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.221487 Nov 02 12:31:57.856790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 186/388] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:57 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:31:57.865362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:57.866885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:57.874139 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.874638 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.875077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:57.875988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:57.876442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:57.876868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.035490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:58.044837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0549e8a7-7cf8-4a4c-a282-b1d7f8edd4de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.187122 Nov 02 12:31:58.045448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 203/389] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:57 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:31:58.597948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:58.599066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:58.609351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.610235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.611089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.612063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.612547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.612990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.779351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:58.787710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0dbbdedc-ed41-489d-a326-f23d639f2b9b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.198699 Nov 02 12:31:58.788324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 187/390] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:58 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:58.886320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:58.887295 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:58.897282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.898051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.898644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:58.899626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:58.900430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:58.901231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.073650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:59.074456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:59.088856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.089639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.090551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.092047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.092960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.093800 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.094011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:59.105142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:59.107009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:59.108836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-74d1617a-874a-423a-8c00-4f7d5d498845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.228722 Nov 02 12:31:59.109449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 204/391] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:31:58 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:31:59.275432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:31:59.283546 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f28105f3-7d1d-409e-b253-aa408e8b0c76 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.215278 Nov 02 12:31:59.284752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 188/392] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:59 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:31:59.828538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:31:59.829281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:31:59.836058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.836643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.837199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.838054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:31:59.838595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:31:59.839097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:31:59.999083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.007322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e3a64547-9a3d-407e-9457-91d90f1152bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.182612 Nov 02 12:32:00.007908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 205/393] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:31:59 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:00.149336 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:00.149945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:00.158567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.159840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.160322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.160982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.161454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.162054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.308058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:00.308812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:00.316814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.325282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.329177 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.329557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.330147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.330663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.330981 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a7d7b9fe-9129-471b-9943-ac2bd712e4c8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.190012 Nov 02 12:32:00.332085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:00.332665 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 189/394] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:00 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:00.337045 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:00.337671 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:00.527831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:00.541311 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bf05cd5d-8632-4fe5-91a5-da1f7a8e0b30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.237140 Nov 02 12:32:00.542195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 206/395] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:00 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:01.030717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.031325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.037561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.038054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.038485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.039191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.039700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.040250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.205085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.217722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e99f3361-8f9e-4344-97c7-67dd5f1f4589 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.190923 Nov 02 12:32:01.224399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 190/396] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:01.359004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.359588 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.366905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.367381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.367809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.368496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.368940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.369384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.551524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.563754 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:01.564371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:01.570896 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.571421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.571614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.571841 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.572530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:01.572985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:01.573461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:01.575813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.588462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5c847cb-58f2-4ae1-8f47-fe7d081adbe8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.233199 Nov 02 12:32:01.599708 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 207/397] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:01.735527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:01.744306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d958d79e-6518-45ce-a427-454bee2f59cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.184294 Nov 02 12:32:01.745234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 191/398] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:01 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:02.257591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.258208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.264561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.265510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.266084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.266862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.267499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.267821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.457225 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.471647 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-35fdb785-3e0d-4d58-958a-a357441cf774 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.219051 Nov 02 12:32:02.472883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 208/399] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:02 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:02.618358 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.619187 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.625810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.626282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.626710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.627397 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.627861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.629394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.770479 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:02.771638 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:02.775632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.779357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.780140 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.780565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.781551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:02.781947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:02.782368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:02.784898 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.786565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.787755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74763d89-4eee-4eb0-a938-698edbf7cbc0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.173267 Nov 02 12:32:02.801144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 192/400] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:02 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:02.939115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:02.948415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d185603-9156-40fa-b365-f6e5a78915ea tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.181741 Nov 02 12:32:02.949396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 209/401] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:02 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:03.497354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:03.497954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:03.504340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.504822 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.505278 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.505983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.506432 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.506844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.671177 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:03.684837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e99a9c51-5558-41c1-8373-19b7e8be2fb1 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.191204 Nov 02 12:32:03.686633 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 193/402] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:03 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:03.816055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:03.816657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:03.822970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.823493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.823926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.824642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.825165 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.825565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.978649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:03.979797 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:03.987265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.987782 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.988250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.988958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:03.989547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:03.990530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:03.998677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.009027 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.010918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.012268 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8fca35bb-fdea-45d1-aff5-42ea2c4da570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.200922 Nov 02 12:32:04.012951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 210/403] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:03 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:04.169857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.182391 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-59ee0490-1c12-45b4-9cac-3b261ad85001 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.211544 Nov 02 12:32:04.183615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 194/404] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:03 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:04.714125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:04.714924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:04.723915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.724404 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.724835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.725588 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:04.726036 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:04.726456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:04.892373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:04.902496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-009d6237-4e18-439e-bde3-13888de21b5f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.193190 Nov 02 12:32:04.903420 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 211/405] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:04 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:05.039701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:05.040460 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:05.047743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.048229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.048654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.049397 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.049923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.050345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.135565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:05.136814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:05.143224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.144656 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.145315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.146230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.146884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.147309 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.184033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fd945a22-fab5-49f4-8a87-4378abca29b0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/ips" status: 200 len: 146 microversion: 2.1 time: 0.053221 Nov 02 12:32:05.184613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 212/406] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:32:05 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/ips => generated 146 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:05.204967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.206586 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:05.207294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:05.213359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.213905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.214285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.214763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.214986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.215441 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.215868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.216297 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.217617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e61ecc9e-96bf-4284-a2fe-70894a7d911d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.182219 Nov 02 12:32:05.218250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 195/407] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:05 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:05.379737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:05.387971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-626e9aae-1e80-4b6a-a07d-bb0456bf3163 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.185805 Nov 02 12:32:05.388582 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 213/408] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:05 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:05.926872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:05.928344 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:05.936229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.936880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.937222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:05.938232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:05.938883 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:05.939316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.122533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.122533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-319e00e5-a59a-4392-a7ee-17819ca5d285 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.199354 Nov 02 12:32:06.123416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 196/409] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:05 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:06.247689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:06.248231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:06.255251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.255727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.256152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.256983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.257604 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.258025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.393075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.402397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.404152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.406583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-74de248c-80c4-4a9a-ae5e-14179b262423 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.161961 Nov 02 12:32:06.406583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 214/410] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:06.417632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:06.418138 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:06.425696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.426275 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.426785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.427554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:06.428159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:06.428660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:06.577359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:06.585597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bc5b9c0b-656d-4f88-a37d-fbd614e1dc0f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.171933 Nov 02 12:32:06.586170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 197/411] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:06 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:07.148785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:07.149339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.155385 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.155871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.156303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.157018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.157495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.157913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.293726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.295996 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:07.303080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1874479e-c0ca-4503-8192-49690c3aaee8 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.158541 Nov 02 12:32:07.303649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 215/412] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:07 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:07.439600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:07.440703 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.447372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.447848 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.448277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.448967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.449449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.449866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.586691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.596930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.598406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.599571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e66ffe38-258b-416f-a056-7460da0f74d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.163901 Nov 02 12:32:07.600135 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 198/413] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:07 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:07.612821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:07.613459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:07.619527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.620007 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.620462 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.621164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:07.621617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:07.622037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:07.757030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:07.764806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-31e7a7b3-ff63-4e99-bef4-3454323b1be7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.155895 Nov 02 12:32:07.765689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 216/414] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:07 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:08.324886 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.325677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.333467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.333958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.334404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.335118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.335582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.336012 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.470728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.478646 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c22ce53d-9021-4630-9e2a-22ae86e15e08 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.157818 Nov 02 12:32:08.479211 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 199/415] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:08.624854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.625493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.632094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.632603 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.633071 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.633765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.634214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.634660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.768416 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.777343 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.778789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.779950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4a84e9b7-f516-4ae6-bc13-30652c6394e8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.159070 Nov 02 12:32:08.780514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 217/416] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:08.790687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:08.791292 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:08.797626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.798105 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.798534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.799268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:08.800326 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:08.800743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:08.945238 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:08.953686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a5dedad3-61ff-41e4-88fe-aecbbccf50de tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1260 microversion: 2.1 time: 0.166705 Nov 02 12:32:08.954374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 200/417] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:08 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:09.501743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:09.502277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:09.508926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.509454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.509891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.510597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.511055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.511481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.734255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:09.743563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-501b6984-af6d-489e-8e75-599847a2536a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.245896 Nov 02 12:32:09.744141 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 218/418] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:09 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:09.812035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:09.813102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:09.822856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.823642 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.824361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.825985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.826821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.827574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.975078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:09.976544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:09.977259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:09.984129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.984623 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.985585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.986493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:09.987663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:09.988280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:09.988749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:09.990441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:09.992410 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-45b612d9-01c0-4d9d-adfd-bbacc7fc9185 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.187419 Nov 02 12:32:09.992850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 201/419] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:09 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:10.176433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:10.190455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e63d82a-23d8-41f3-a108-6e0b081ab372 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1444 microversion: 2.1 time: 0.217444 Nov 02 12:32:10.205085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 219/420] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:09 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1444 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:10.217516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:10.218724 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:10.226791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.227287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.228371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.229772 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.230287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.230913 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.236353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=100 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:10.407621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:10.416261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4c6b33ed-e959-4e20-a01c-b70275b9ea90 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1444 microversion: 2.1 time: 0.203247 Nov 02 12:32:10.416844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 202/421] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:10 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1444 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:10.770339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:10.771005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:10.781318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.782199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.783006 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:10.784273 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:10.785085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:10.785856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:11.026415 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:11.029254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:11.051089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:11.057563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:11.059333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:11.060921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:11.061748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:11.062416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:11.138082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:11.152084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1391e362-dbc7-4dc5-845e-435ee07426ef tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.388655 Nov 02 12:32:11.169548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 220/422] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:10 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:11.312424 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:11.323933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:11.325685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:11.327102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1eafa5c2-2d16-46a9-953f-15f82b235833 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.312318 Nov 02 12:32:11.328298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 203/423] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:11 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:11.479620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aefba506-383c-468c-8a7d-f5ea7921ff82"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:11.482239 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:11.497793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:11.503007 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:11.503469 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:11.504745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:11.505608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:11.506229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.176136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:12.177316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:12.184758 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.186057 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.186909 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.187873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.188551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.189263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.589203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:12.609938 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8154ecf2-7b2a-4c4d-b352-19cb1e45e033 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1370 microversion: 2.1 time: 0.437871 Nov 02 12:32:12.611430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 204/424] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:12 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1370 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:12.633284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:12.634347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:12.645642 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.646384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.647114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.648227 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:12.648687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:12.649546 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:12.683311 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-85232a0e-5db8-49f1-8efd-5a34e081c255 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.216248 Nov 02 12:32:12.686092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 221/425] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:32:11 2022] POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments => generated 194 bytes in 1222 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:12.936766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:12.946282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:12.947796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:12.948971 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2895fb6f-776d-45d9-8fcc-cb6dd47b618a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.336388 Nov 02 12:32:12.949859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 205/426] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:12 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:13.247983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:13.266003 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.266913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.277266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.300979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] Creating event network-changed:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:32:13.308929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-5fecdbb7-9313-4235-9615-67ccc470757a req-958b1f73-ef7e-47d0-b042-191d5e5a25dd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066459 Nov 02 12:32:13.312700 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 222/427] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:13.636126 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:13.636933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:13.646846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.647777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.648674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.650943 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.651603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.652713 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.832593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:13.841702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c090ab79-6aed-4320-a038-c37e53c8bc0d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1563 microversion: 2.1 time: 0.210856 Nov 02 12:32:13.843038 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 206/428] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:13 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1563 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:13.873292 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:13.874501 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:13.882094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.882796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.883512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.884370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:13.884971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:13.885772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:13.976147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:13.977070 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:14.007289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:14.018551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:14.019178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:14.020075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:14.023058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-34bc02d2-f6d9-47fe-ac70-c618edf83078 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.154154 Nov 02 12:32:14.032091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 223/429] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:32:13 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-interface => generated 284 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:14.032353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:14.032353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:14.392768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:14.407465 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:14.414760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:14.415855 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9d4e70c7-f375-40a3-a64d-60d857b4b7ce tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.443716 Nov 02 12:32:14.416424 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 207/430] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:13 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:15.447084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:15.448779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:15.483535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.484182 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.484871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.486021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.486970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.487736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.638137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76afdf9e-f282-4c1b-a8d1-0e89faddc309", "device": "/dev/sdb"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:15.643534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:15.660593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.661219 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.662034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.662883 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.663488 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.666605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.767346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:15.779630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:15.781752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:15.783792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e77f835c-9c24-4596-ba6f-d17e615b886e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.340811 Nov 02 12:32:15.785093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 224/431] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:15 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:15.908818 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:15.932895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:15.934120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:15.934988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:15.953591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] Creating event network-changed:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:32:15.970373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-5ac19055-d331-44b7-a2a1-2b42f88af704 req-273b69eb-6f72-4c96-a7b7-89c9ea01326b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068975 Nov 02 12:32:15.972431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 225/432] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:16.085364 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2dea11c7-b45f-44c9-b600-e0507318a802 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "POST /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.450435 Nov 02 12:32:16.085980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 208/433] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:32:15 2022] POST /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d/os-volume_attachments => generated 194 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:32:16.816396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:16.817239 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:16.829020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:16.829519 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:16.829953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:16.831384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:16.831842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:16.832265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:17.035545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:17.050110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:17.057288 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:17.060765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-33ba7972-bab1-436e-a160-8888007115f5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.250221 Nov 02 12:32:17.074120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 226/434] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:16 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:18.094821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:18.095639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:18.103582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.104076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.104519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.105323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:18.105988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:18.106919 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:18.302728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:18.349417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:18.358704 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:18.365672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-171acd1a-6e89-4414-a0e0-5c928ce28b81 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.273039 Nov 02 12:32:18.368933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 209/435] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:18 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:19.436909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:19.438364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:19.447458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:19.448201 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:19.448837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:19.449773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:19.450395 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:19.451167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:19.621469 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:19.633857 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:19.635287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:19.636454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2e8e6745-6d8b-4f9a-9173-81410f6773c0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.205065 Nov 02 12:32:19.637474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 227/436] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:19 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:19.747565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "name": "network-vif-plugged", "status": "completed", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:19.761508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:19.762250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:19.762716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:19.783926 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] Creating event network-vif-plugged:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:32:19.795074 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-6162b40c-fdc3-4116-b74e-491b9a320d61 req-a0e06486-51f2-4b7a-9b15-75a1361ac602 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051359 Nov 02 12:32:19.795977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 210/437] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:20.664115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:20.664905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:20.672170 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:20.672985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:20.673707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:20.675021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:20.675853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:20.676460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:20.854440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:20.864534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:20.867139 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:20.868616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7594df99-3cd4-4fb0-880a-a21776abe965 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.208742 Nov 02 12:32:20.869858 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 228/438] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:20 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:21.838014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:21.847684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.848504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.849030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.901885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:21.903854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:21.912779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Going to try to stop instance {{(pid=120740) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:32:21.914614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.915344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.916315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.917599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.918399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:21.918912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:21.964425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1a166a95-e051-4162-952e-2fdb6a9e4bda tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action" status: 202 len: 0 microversion: 2.1 time: 0.131111 Nov 02 12:32:21.968385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 211/439] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:32:21 2022] POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:32:21.992374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:21.992374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:21.992374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:21.992374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:22.001506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:22.001506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:22.001506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:22.001506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:22.157598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:22.175894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:22.177730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:22.179034 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d6dcc397-1b9b-479a-8673-249ae8a543d6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.284900 Nov 02 12:32:22.179699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 229/440] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:21 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:22.207091 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:22.214647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d5ac02f3-68f3-400b-b839-d17fda8aaeea tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.238838 Nov 02 12:32:22.215299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 212/441] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:21 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:23.211840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:23.213541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:23.226155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.227418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.228287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.229961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.230950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.231393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.239586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:23.240472 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:23.249304 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.250059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.250693 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.251570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:23.252988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:23.253586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:23.437132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.445914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d90efd98-ba71-45b6-b7a6-6054e57c5495 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.210448 Nov 02 12:32:23.446489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 213/442] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:23 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:23.467995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.478222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.480398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:23.481891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-15af27a7-e4af-4ea0-92a4-61c537b19434 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.278058 Nov 02 12:32:23.483046 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 230/443] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:23 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:32:24.479456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.482557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:24.498608 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.500412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.501074 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.503645 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.504419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.505628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.515221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:24.515828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:24.529131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.529779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.530324 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.531272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:24.532000 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:24.535335 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:24.765444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.777235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.778963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.779131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:24.781622 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4cc22e1e-58c6-48c4-af23-27cf34ac991e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1808 microversion: 2.20 time: 0.270030 Nov 02 12:32:24.784125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 231/444] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:24 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:24.794322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cb91df91-3e21-4b73-9170-24da140afcd2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.327689 Nov 02 12:32:24.795560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 214/445] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:24 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:25.817958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:25.819002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:25.824962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:25.826185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:25.831300 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=67 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:25.835989 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.839841 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.840594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.841747 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.842139 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.842565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.842685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.843050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.843574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:25.843759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:25.844379 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:25.844803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:26.018296 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:26.020663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:26.031798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:26.034176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:26.035862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-58067c1b-fd56-4bc4-916a-7aeb7910e857 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1795 microversion: 2.20 time: 0.226115 Nov 02 12:32:26.049025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 232/446] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:32:25 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1795 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:32:26.064868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:26.077666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b9be432-df45-477b-9c82-d4f76c23d6fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.257024 Nov 02 12:32:26.079521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 215/447] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:25 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:27.121701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:27.123017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:27.127914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=64 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:27.138757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:27.139465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:27.139904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:27.140787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:27.141402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:27.141828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:27.303710 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:27.317449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fd65d05e-7791-4036-9033-5ad37d2ab37c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.200445 Nov 02 12:32:27.318890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 233/448] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:27 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:28.342353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:28.342976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:28.349641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.350116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.350585 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:28.351302 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:28.351740 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:28.352153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:28.499000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:28.508611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0bfb2e81-b5c5-4d73-9822-5a3d02726ce7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.169977 Nov 02 12:32:28.509316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 216/449] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:28 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:29.533788 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:29.534573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:29.542024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:29.543196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:29.543196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:29.543904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:29.544523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:29.545128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:29.690184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:29.699008 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1243c154-1967-4450-80a0-4c169a7368d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.169776 Nov 02 12:32:29.699609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 234/450] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:29 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:30.728120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:30.729301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:30.741324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:30.742175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:30.742943 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:30.744181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:30.744990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:30.745795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:30.754120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:30.893585 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:30.902130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-82a37065-2938-4143-89e7-6ce4e2e2563e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.181890 Nov 02 12:32:30.902704 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 217/451] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:30 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:31.928863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:31.929722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:31.936899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.937431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.937859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:31.938672 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:31.939129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:31.940238 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:32.079082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:32.087417 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-917dae8f-a92e-435c-a5af-09ffb3a81428 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.163542 Nov 02 12:32:32.087986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 235/452] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:31 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:33.112008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:33.112687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:33.114985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:32:33.115207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Wed Nov 2 12:32:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f (ip 10.222.0.85) !!! Nov 02 12:32:33.122807 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:33.123284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:33.123718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:33.124416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:33.124856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:33.125312 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:33.269190 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:33.277715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-93df6b4a-e8ad-4cbb-a61c-ba8a7605c2d6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.169707 Nov 02 12:32:33.278302 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 218/453] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:33 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:34.301574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:34.302381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:34.309487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:34.309973 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:34.310444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:34.311152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:34.311602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:34.312017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:34.463791 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:34.472794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-aec46024-d69e-49de-ac8d-24b454363efc tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.175272 Nov 02 12:32:34.473472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 236/454] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:34 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:35.497250 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:35.497878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:35.505256 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:35.505746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:35.506185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:35.506892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:35.507342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:35.507763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:35.653052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:35.662080 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2d839c85-811c-4b86-a367-78881084cc14 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.168755 Nov 02 12:32:35.662659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 219/455] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:35 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:36.686692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:36.687573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:36.694402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:36.694887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:36.695328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:36.696023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:36.696474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:36.696889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:36.844612 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:36.854409 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-131ec561-486c-4cd8-9071-87c35d2a98a2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.171623 Nov 02 12:32:36.854988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 237/456] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:36 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:37.879805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:37.880405 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:37.886934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.887421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.887849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:37.888545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:37.888990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:37.889434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:38.030048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:38.035909 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b8354c5c-846f-48f6-be63-f7cc73adbc8e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.160671 Nov 02 12:32:38.036323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 220/457] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:37 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:39.059660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:39.061637 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:39.069190 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:39.069634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:39.070065 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:39.070761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:39.071200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:39.071673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:39.213067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:39.223393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-967a2b1b-37a9-4e86-b646-85971799b000 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.167559 Nov 02 12:32:39.224145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 238/458] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:39 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:40.248179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:40.248796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:40.256685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:40.257222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:40.257654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:40.258469 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:40.258818 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:40.259243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:40.402815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:40.416274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ac883765-7d1b-41bf-83f5-fe91ac35f6c3 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.171778 Nov 02 12:32:40.417287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 221/459] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:40 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:41.442526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:41.443130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:41.449952 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:41.450445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:41.450879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:41.451646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:41.452103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:41.452541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:41.586152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:41.594520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5b0c018c-7495-4f71-9052-d37e3e262f01 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.156421 Nov 02 12:32:41.595087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 239/460] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:41 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:42.618143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:42.618730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:42.625256 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:42.625741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:42.626182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:42.626882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:42.627590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:42.628011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:42.762359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:42.771158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ef046df-124e-4ea3-968c-b39bb1d4a2b7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.156922 Nov 02 12:32:42.771727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 222/461] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:42 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:43.794786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:43.795406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:43.802271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.802746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.803183 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.803865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:43.804316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:43.804734 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:43.942569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:43.951416 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a6e07d6a-f351-41c2-8eab-685d9e707c4e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.160678 Nov 02 12:32:43.952002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 240/462] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:43 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:44.975551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:44.976272 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:44.982745 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.983243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.983672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:44.984351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:44.984795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:44.985249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:45.115062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:45.129535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b50c51a-6b54-4c13-baf6-2969febd7c88 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.157605 Nov 02 12:32:45.131007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 223/463] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:44 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:46.155200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:46.155808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:46.162938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.163422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.163860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:46.164564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.165041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.165481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:46.306247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:46.315131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-27202f38-9ccb-4e63-b7ab-e04a5904704c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.163843 Nov 02 12:32:46.315735 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 241/464] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:46 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:46.713631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:46.714133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:46.720485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.720969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.721441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:46.722135 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:46.722590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:46.723072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:46.848872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lazy-loading 'services' on Instance uuid 8d540597-ace2-4cfb-841d-d020330f5e9d {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:46.975230 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eaae1e52-5ed1-4799-8324-56a5f1f654da tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d/os-volume_attachments/76afdf9e-f282-4c1b-a8d1-0e89faddc309" status: 202 len: 0 microversion: 2.1 time: 0.265344 Nov 02 12:32:46.975863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 224/465] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:32:46 2022] DELETE /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d/os-volume_attachments/76afdf9e-f282-4c1b-a8d1-0e89faddc309 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:32:47.339650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:47.340180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:47.347157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.347637 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.348072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.348760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:47.349241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:47.349660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:47.480518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:47.488812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c5a94243-b952-461d-ad64-a7c775cdae29 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.153389 Nov 02 12:32:47.490012 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 242/466] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:47 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:48.103748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:48.104284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.111075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.111554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.111979 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.112672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.113144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.113567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.140205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:32:48.218550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d12e2116-3786-4468-9a25-7c3682317fe2 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "DELETE /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 204 len: 0 microversion: 2.1 time: 0.119373 Nov 02 12:32:48.219474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 225/467] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:32:48 2022] DELETE /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:32:48.229115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:48.229829 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.235728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.236229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.236645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.237361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.237814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.238233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.370247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.378786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-26288634-c9a5-48b2-98a2-c1de6b16b892 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1513 microversion: 2.1 time: 0.153930 Nov 02 12:32:48.379345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 243/468] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:48 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:48.513409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:48.514109 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:48.520514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.521023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.521454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.522164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:48.522616 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:48.523036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:48.655688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:48.664801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d0e0997e-61c0-48f8-9a9b-1236eded7613 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.155592 Nov 02 12:32:48.665524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 226/469] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:48 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:49.401880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:49.402476 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:49.409842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.410335 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.410767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.411475 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.411926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.412383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.550907 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.559211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-20c6aadb-c66e-4088-9225-c9e602717a52 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1513 microversion: 2.1 time: 0.161163 Nov 02 12:32:49.559795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 244/470] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:49 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:49.688307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:49.689496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:49.695836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.696371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.696745 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.697481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:49.697934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:49.698352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:49.835384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:49.844800 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-adaa4022-03fa-4069-bbaf-f9a573341bc2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.160437 Nov 02 12:32:49.845405 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 227/471] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:49 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:50.583775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:50.584401 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:50.591178 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.591667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.592105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.592816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.593298 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.593723 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.730835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:50.738772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6362f76c-33fe-4e56-b84c-47004563d9d9 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1513 microversion: 2.1 time: 0.159385 Nov 02 12:32:50.739345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 245/472] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:50 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:50.867820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:50.869140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:50.876034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.876518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.877222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:50.877930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:50.878406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:50.878826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.011691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.021424 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cf6d0d45-b505-4e69-9592-9e9b8be3a69e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.157449 Nov 02 12:32:51.021999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 228/473] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:50 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:32:51.761880 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:51.762435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:51.769025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.769529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.769964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.770659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:51.771111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:51.771531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:51.904303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:51.915175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e8d7af2a-f867-457b-bb3b-245fcdde1a8e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1513 microversion: 2.1 time: 0.157155 Nov 02 12:32:51.915745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 246/474] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:51 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:52.045237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:52.045874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:52.052783 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.053341 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.053781 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.054471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.054924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.055344 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.242080 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:52.250438 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b1683c9-1f76-4e42-a288-ca9d04459ec5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1724 microversion: 2.1 time: 0.209120 Nov 02 12:32:52.251014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 229/475] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:52 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1724 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:52.380747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d540597-ace2-4cfb-841d-d020330f5e9d", "name": "network-vif-deleted", "tag": "a2cd9294-40e8-4c72-92e4-4a022321affe"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:52.393194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.393682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.394174 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.416972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] Creating event network-vif-deleted:a2cd9294-40e8-4c72-92e4-4a022321affe for instance 8d540597-ace2-4cfb-841d-d020330f5e9d on hv-cinder-86327 Nov 02 12:32:52.422887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-1a4beb34-67a4-4208-b7be-c64424592ecd req-c620eb85-3810-45b0-8d5a-7b12cc1103eb service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046001 Nov 02 12:32:52.423764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 247/476] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:32:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:32:52.940043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:52.940637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:52.946742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.947212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.947636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.948317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.948759 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.949208 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.980446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:52.980907 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:52.981363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:52.981797 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lazy-loading 'fault' on Instance uuid 8d540597-ace2-4cfb-841d-d020330f5e9d {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:32:53.024088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.032716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-33e89b2f-e49a-477e-bab7-8960cc08bfac tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 200 len: 1309 microversion: 2.1 time: 0.096457 Nov 02 12:32:53.033386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 230/477] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:52 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:53.277800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:53.278689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:53.288792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.289319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.289755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.290553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.291008 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.291428 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.441219 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.449892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-924eb014-a36f-49e9-9c58-dfb848020994 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1701 microversion: 2.1 time: 0.177970 Nov 02 12:32:53.450465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 248/478] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:53 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1701 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:53.483473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:32:53.493579 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.494066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.494500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.497065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:53.521722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Going to try to start instance {{(pid=120740) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:32:53.566494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9d45256e-41a2-4a6d-b117-e4f48e03c03d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action" status: 202 len: 0 microversion: 2.1 time: 0.089951 Nov 02 12:32:53.567211 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 231/479] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:32:53 2022] POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:32:53.576294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:53.577401 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:53.590148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.590726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.591154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.591844 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:53.593516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:53.593897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:53.733397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:53.742675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-80f1497c-5d88-4bbe-8af1-1f13b57eeddd tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1710 microversion: 2.1 time: 0.170521 Nov 02 12:32:53.744304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 249/480] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:53 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1710 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:54.058335 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:54.059036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 8d540597-ace2-4cfb-841d-d020330f5e9d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:54.065423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.065915 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.066351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:54.067159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.067632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.068100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:54.081970 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] HTTP exception thrown: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Request method failure captured: Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d HTTP/1.1 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmMg-fVqqA1OWy0zOGMv27WbSlHEepOcysD5LV6BLRjOFTeznndd75nqQOa_k1m9yMFKI8uNYY3AV2h-CBe4VASCF_cFjzBMpRpwoKQdztOw3nZTVZ3xOJhIeeEltOKpNAI0f-azhTAb2zDdHWvSDqlpnWCSzPWJVPuf6vjYYg_260Y Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 64af2cf0e0a14b3ea92c2438baeeb900 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:32:54.083619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 64af2cf0e0a14b3ea92c2438baeeb900 Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-VolumesSnapshotTestJSON-1078910471-project Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: d655fb9352544adf8b3bac0cfa202d9e Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-VolumesSnapshotTestJSON-1078910471-project Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. Nov 02 12:32:54.085271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '8d540597-ace2-4cfb-841d-d020330f5e9d'} Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:32:54.086141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. Nov 02 12:32:54.087648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:32:54.089555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Returning 404 to user: Instance 8d540597-ace2-4cfb-841d-d020330f5e9d could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:32:54.089555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3b6446f5-ae45-457b-b2db-e72705d21d27 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d" status: 404 len: 111 microversion: 2.1 time: 0.030972 Nov 02 12:32:54.089555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 232/481] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:54 2022] GET /compute/v2.1/servers/8d540597-ace2-4cfb-841d-d020330f5e9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:32:54.767342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:54.767943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:54.775080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.775697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.776154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:54.776848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:54.777335 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:54.778012 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:54.780885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:54.920267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:54.928660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-78d8283c-ae6d-4269-95e0-38552be0bad0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1710 microversion: 2.1 time: 0.165767 Nov 02 12:32:54.929472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 250/482] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:54 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1710 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:55.952745 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:55.953436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:55.956457 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:55.962280 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.963140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.963843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:55.964299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:55.964753 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:55.965207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:56.100655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:56.109809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0a318a46-29f3-40b9-9b66-bb873c509f53 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1710 microversion: 2.1 time: 0.160840 Nov 02 12:32:56.110393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 233/483] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:55 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1710 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:57.133973 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:57.134541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:57.138031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=36 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:32:57.142572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.143051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.143488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:57.144191 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:57.144641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:57.145371 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:57.280135 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:57.288952 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-90c87f3a-edc7-4fbe-b50f-435b73b6f31d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1710 microversion: 2.1 time: 0.158862 Nov 02 12:32:57.289577 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 251/484] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:57 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:32:58.312985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:32:58.313639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:32:58.321260 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.321741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.322171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.322866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:32:58.323340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:32:58.323757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:32:58.464128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:32:58.473894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c84c2990-ad8c-4791-aec0-b3bbb690b65a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1714 microversion: 2.1 time: 0.164610 Nov 02 12:32:58.474545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 234/485] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:32:58 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1714 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:04.068327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1545461427", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "networks": [{"uuid": "198d3999-966c-482d-951f-86abbbcd5ae3"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:04.124837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] validate_networks() for [('198d3999-966c-482d-951f-86abbbcd5ae3', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:04.508166 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:33:04.508585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:33:04.509213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:33:04.509623 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:33:04.510029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:33:04.518897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.519368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.519793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:04.520508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:04.520949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:04.521396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:04.539320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Getting quotas for project 64af2cf0e0a14b3ea92c2438baeeb900. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:04.543803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Getting quotas for user d655fb9352544adf8b3bac0cfa202d9e and project 64af2cf0e0a14b3ea92c2438baeeb900. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:04.555927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:33:04.558465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:33:04.618026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-506fdbcc-ba4f-41ac-aa2f-8418adcaaa60 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.554504 Nov 02 12:33:04.618864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 252/486] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 556 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:33:04.630955 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e16b8854-42f1-44cf-b1e2-a156af1a12c4 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:04.631561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e16b8854-42f1-44cf-b1e2-a156af1a12c4 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:04.693540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e16b8854-42f1-44cf-b1e2-a156af1a12c4 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:04.700864 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e16b8854-42f1-44cf-b1e2-a156af1a12c4 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1219 microversion: 2.1 time: 0.074125 Nov 02 12:33:04.701778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 235/487] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:04 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1219 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:05.724362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:05.724968 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:05.732007 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.732917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.732917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.733682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:05.734153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:05.734568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:05.805455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:05.813346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dba85324-d1eb-4ce4-adf2-2f00cd645637 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1271 microversion: 2.1 time: 0.093377 Nov 02 12:33:05.813944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 253/488] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:05 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:06.838998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:06.839624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:06.846276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.846838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.847278 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:06.847994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:06.848479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:06.848898 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:07.092164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:07.102752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5e91427a-4989-4207-aa31-57e30bb34f99 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.267671 Nov 02 12:33:07.103501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 236/489] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:06 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:07.897165 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b44e3d6-f0dc-46fd-9172-0f06d64e379b", "tag": "8e87082a-b161-4ab1-b5c5-6358ccc014b4"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:07.915941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:07.916602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:07.917338 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:07.930247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] Creating event network-changed:8e87082a-b161-4ab1-b5c5-6358ccc014b4 for instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b on hv-cinder-86327 Nov 02 12:33:07.935846 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-8fb2d35a-36b7-4723-b1fb-ef3158d3b2b2 req-2411ee99-d144-4c1f-a47b-28fbe4e81cb7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046797 Nov 02 12:33:07.936481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 254/490] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:08.143638 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:08.144195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:08.152551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.153140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.153576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.154284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:08.154728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:08.155148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:08.388619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:08.398883 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-21d77411-4c25-43ee-8807-3e95337e2c1e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.259086 Nov 02 12:33:08.399478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 237/491] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:08 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:09.425090 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:09.425789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:09.432554 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.433053 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.433491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.434185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:09.434628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:09.435043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:09.602431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:09.611301 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9b52dbcc-efe4-4419-a60d-d636d717f83b tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.191340 Nov 02 12:33:09.611886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 255/492] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:09 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:10.634545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:10.635406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:10.642306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:10.642725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:10.643161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:10.643857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:10.644311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:10.644736 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:10.778460 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:10.786626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bef90929-b2ab-4010-9350-57e3f5d8d4e7 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.155843 Nov 02 12:33:10.787192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 238/493] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:10 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:11.808763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:11.809398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:11.815537 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:11.816048 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:11.816452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:11.817735 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:11.818243 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:11.818742 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:11.948066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:11.955632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fab06ac3-71df-4c22-8b20-35ffa500675a tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.151040 Nov 02 12:33:11.956195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 256/494] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:11 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:12.978778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:12.979383 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:12.986182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:12.986661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:12.987089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:12.987840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:12.988213 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:12.988636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:13.121433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:13.130172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ea595d9-2e57-4830-acdf-ecc770a5f749 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.154830 Nov 02 12:33:13.130921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 239/495] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:12 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:14.152441 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:14.153088 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:14.160060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.160477 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.160910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.161636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:14.162088 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:14.162507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:14.303520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:14.311064 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-76e34ff1-3bcd-43ce-b0fa-b60406b7ca3d tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.162498 Nov 02 12:33:14.311628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 257/496] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:14 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:15.335571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:15.336122 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:15.338555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:15.344493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.345052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.345518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.346220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.346674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.347101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.491316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:15.499798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-98401ee1-b535-4e67-942f-fee1af5869ca tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.168927 Nov 02 12:33:15.500379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 240/497] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:15 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:15.592030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b44e3d6-f0dc-46fd-9172-0f06d64e379b", "name": "network-vif-plugged", "status": "completed", "tag": "8e87082a-b161-4ab1-b5c5-6358ccc014b4"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:15.598108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:15.598814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:15.607037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:15.607517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:15.607942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:15.619845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] Creating event network-vif-plugged:8e87082a-b161-4ab1-b5c5-6358ccc014b4 for instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b on hv-cinder-86327 Nov 02 12:33:15.626833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-f3f2aa31-0882-4bc6-8afd-7d79a4bb0f8d req-974c0b96-16ac-43bb-b0f9-ebddfd4adbce service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038760 Nov 02 12:33:15.628092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 258/498] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:16.523105 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:16.523712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:16.530136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.530614 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.531039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.531716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:16.532167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:16.532579 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:16.667309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:16.677312 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6323f4a9-57de-4303-b951-f6e51ec69a07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.156976 Nov 02 12:33:16.677904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 241/499] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:16 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:17.700534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:17.701739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:17.713999 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.714994 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.715854 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.717129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:17.718030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:17.718787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:17.878545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:17.886887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9bc0625e-57f2-4971-ba42-e3c948a4216c tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1319 microversion: 2.1 time: 0.191135 Nov 02 12:33:17.887690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 259/500] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:17 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:18.910529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:18.911141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:18.918335 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.918813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.919247 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:18.919941 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:18.920390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:18.920811 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.058403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:19.066408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f30eafb0-aae6-4ce9-aa5e-f0b7da2c8493 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1508 microversion: 2.1 time: 0.159662 Nov 02 12:33:19.067605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 242/501] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:18 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:19.089349 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "57f6b50f-56d1-4a06-af27-1374be2f808c", "device": "/dev/sdb"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:19.092286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:19.098701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.099253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.099619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.100316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:19.100768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:19.101221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:19.356687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08e4e7da-b789-4a38-af16-44c550e24199 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "POST /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.271084 Nov 02 12:33:19.357249 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 260/502] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:33:19 2022] POST /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:23.783235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1060256427", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:23.843230 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] validate_networks() for None {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:24.129518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:33:24.129946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:33:24.130446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:33:24.130878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:33:24.131288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:33:24.141283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.141768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.142205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.142936 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.143391 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.143854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.151815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:24.166254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Getting quotas for project 76e1252062164975b8ac89f6181c4c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:24.170718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Getting quotas for user deebae0bfcac4aa894d4c388d9f4f1e3 and project 76e1252062164975b8ac89f6181c4c4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:24.183013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:33:24.185378 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:33:24.233540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fd71cc0e-afc4-46d3-ad11-ba136bfdbc1c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.454023 Nov 02 12:33:24.234194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 243/503] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:33:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 455 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:33:24.253062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0953a49c-4171-48fe-81d3-f8bbdb8233ba tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:24.254533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0953a49c-4171-48fe-81d3-f8bbdb8233ba tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.317289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0953a49c-4171-48fe-81d3-f8bbdb8233ba tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:24.327013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0953a49c-4171-48fe-81d3-f8bbdb8233ba tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1215 microversion: 2.1 time: 0.081097 Nov 02 12:33:24.327787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 261/504] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:24 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:24.521533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb344411-e26c-4c5f-83f6-5308b8929365"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:24.524073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.533581 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.534219 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.534792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.536153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.536921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.537453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.645908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:24.646975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.659300 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.660680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.661502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.662900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.663889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.664551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.714764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8c337a45-c32f-4e4f-b5a6-0599824171da tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments/23896349-7ff8-4dd7-91d2-853c7e855fab" status: 200 len: 194 microversion: 2.20 time: 0.076534 Nov 02 12:33:24.716355 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 262/505] 10.222.0.85 () {60 vars in 1454 bytes} [Wed Nov 2 12:33:24 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments/23896349-7ff8-4dd7-91d2-853c7e855fab => generated 194 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:24.804859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:24.805822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:24.819574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.821248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.822243 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.826141 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:24.827426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:24.828367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:24.887394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-43626ee0-8ccd-4a28-9a9e-cb101b02fe3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.369832 Nov 02 12:33:24.887917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:24.894254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 244/506] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:33:24 2022] POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments => generated 194 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:25.002168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'services' on Instance uuid c684f91d-7d77-4303-99ad-d73b293539a4 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:25.123737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-005caac3-bcd9-45a6-9fb3-bb49388a9845 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments/23896349-7ff8-4dd7-91d2-853c7e855fab" status: 202 len: 0 microversion: 2.20 time: 0.327904 Nov 02 12:33:25.124875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 263/507] 10.222.0.85 () {60 vars in 1457 bytes} [Wed Nov 2 12:33:24 2022] DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments/23896349-7ff8-4dd7-91d2-853c7e855fab => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:33:25.134648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.137327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.143743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.144236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.145280 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.145889 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.146343 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.146764 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.182439 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8c34d9f2-5517-4021-b767-1edac98975a4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052617 Nov 02 12:33:25.183025 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 245/508] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:25.358883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:25.363770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:25.367459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.368003 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.368596 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.369354 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:25.369814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:25.370242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:25.435685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:25.445032 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44dde6a5-c216-470a-be2d-c9c108e18876 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1267 microversion: 2.1 time: 0.090350 Nov 02 12:33:25.445767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 264/509] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:25 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1267 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:26.201802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:26.205418 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.209590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:26.219478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.219891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.220347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.221075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.221530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.221953 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.259749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-498f242f-597b-4307-a747-2399377817ee tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065567 Nov 02 12:33:26.260788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 246/510] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:26 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:26.470619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:26.471582 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:26.479002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.479684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.480670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.481279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:26.481895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:26.482387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:26.563078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:26.574053 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-654cd000-8bc1-4736-8821-d610f0aa1975 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1267 microversion: 2.1 time: 0.107755 Nov 02 12:33:26.574839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 265/511] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:26 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1267 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:27.274121 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:27.276308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:27.284117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.284726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.285847 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.286636 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.287183 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.287676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.324121 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2bf5be5a-e936-4364-844b-fd49cd04d909 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054821 Nov 02 12:33:27.324589 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 247/512] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:27 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:27.602199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:27.602893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:27.605650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:27.611974 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.612483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.612937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.613767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:27.614251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:27.614675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:27.775884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:27.786059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d51e3876-be77-4061-8395-7bc94d999aac tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.188051 Nov 02 12:33:27.787159 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 266/513] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:27 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:28.337442 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:28.339600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:28.346428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.346909 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.347338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.348054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.348494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.348911 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.381815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fef12c2e-d04e-4277-b5ad-d1bc894829f1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048428 Nov 02 12:33:28.382400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 248/514] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:28 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:33:28.810295 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:28.810993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:28.817637 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.818161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.818632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.819293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:28.819727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:28.820142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:28.982700 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:28.991613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-77375e67-b0d0-43c3-b3f1-2be042337007 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.185245 Nov 02 12:33:28.992336 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 267/515] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:28 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:29.395458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:29.397872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:29.407222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.408187 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.408962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.411261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:29.412461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:29.413354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:29.476178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5c5a2926-be96-43e9-b3bf-4cfe0a61b289 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.084234 Nov 02 12:33:29.477291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 249/516] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:29 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:33:30.015692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:30.016389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:30.023674 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.024163 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.024598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.025366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.025911 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.026341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.073684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149aa06c-0add-4f04-b408-724d0d4f3e2e", "tag": "8f4d5990-9fd3-45f8-954e-96fc11468fac"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:30.092795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.093697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.094771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.117895 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] Creating event network-changed:8f4d5990-9fd3-45f8-954e-96fc11468fac for instance 149aa06c-0add-4f04-b408-724d0d4f3e2e on hv-cinder-86327 Nov 02 12:33:30.127704 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0d9f3953-9f44-4a55-9d18-3e16a48f94a4 req-4e79157b-9587-48fd-871a-2861f8243761 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060274 Nov 02 12:33:30.128986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 250/517] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:33:30.204255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:30.216322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3309a6d9-5263-4b48-ad10-f1d1fa82468c tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.203895 Nov 02 12:33:30.217184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 268/518] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:30 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:30.489934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:30.492576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:30.500128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.500797 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.501757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.502720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:30.503373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:30.503997 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:30.541135 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-49698bcb-d2f5-4b86-b01d-9f304606c413 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056077 Nov 02 12:33:30.541704 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 251/519] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:30 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:31.246115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:31.246864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:31.254657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.255127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.255566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.256277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.256739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.257216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.455575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:31.475230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-faaa8541-6141-4dbd-a74b-96a3377060dc tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.232308 Nov 02 12:33:31.476087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 269/520] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:31 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:31.557167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:31.560912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:31.574241 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.575181 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.575713 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.576530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:31.577076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:31.577630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:31.619714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-41f8c058-bf7f-4d40-a012-b53e1d8cd7c4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070216 Nov 02 12:33:31.620319 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 252/521] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:31 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:32.508795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.509507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.516342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.516826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.517291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.518013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.518468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.518886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.639792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:32.642268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:32.650722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.651206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.651646 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.652360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:32.652813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:32.653266 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:32.679271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:32.688248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6e1c37e9-799d-4870-ab7e-faf1c2fb552a tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.183249 Nov 02 12:33:32.688951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c9535780-6104-423f-902e-17c80a36e1d3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055967 Nov 02 12:33:32.689572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 253/522] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:33:32.691986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 270/523] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:32 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:33.702564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:33.704757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:33.712808 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.713347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.713790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.714274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:33.714757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.714966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:33.715081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.715412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.726403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.727159 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.727929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.729274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:33.730116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:33.730867 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:33.750379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5f0954ee-fbad-40ae-b46b-68f797f23233 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052247 Nov 02 12:33:33.750976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 254/524] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:33 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:33.890403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:33.903472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dd7ac024-2d88-4305-9dc2-1dc074c264af tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.194200 Nov 02 12:33:33.904439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 271/525] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:33 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:34.763595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.765767 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.767822 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:34.768493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:34.775528 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.776052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.776482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.777219 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.777676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.778093 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.816441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-86020852-1d45-479d-b280-92632a3388e6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056781 Nov 02 12:33:34.817254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 255/526] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:34 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:34.928599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:34.929188 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:34.931224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:34.937682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.938166 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.938591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:34.939295 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:34.939745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:34.940180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.091136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:35.102703 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae399d38-ee95-4a94-99da-633f56e5cf65 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.178429 Nov 02 12:33:35.104388 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 272/527] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:34 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:35.832292 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:35.836392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:35.844763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.845294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.845713 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.846622 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:35.846894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:35.847915 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:35.882147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3879ddb4-520d-408f-9352-8e7013fea5d4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055501 Nov 02 12:33:35.882641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 256/528] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:35 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:36.128706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.129346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.136023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.136429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.136858 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.137578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.138025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.138452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.284055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:36.292719 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-58a2f16f-7766-439f-a714-c08fe2aaac11 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.168476 Nov 02 12:33:36.301108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 273/529] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:36.818881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:36.820940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.827271 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.827761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.828732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.829564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.830231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.830664 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.855967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'flavor' on Instance uuid d421a0ad-d6ba-492d-9d77-90d12500d3e6 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:36.899316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:36.903366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:36.913887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.914518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.915048 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.915997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:36.916514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:36.917305 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:36.958272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d2f8f8b4-1d4b-4ed0-b807-990fc65a6037 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066214 Nov 02 12:33:36.962434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 274/530] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:36 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:33:37.037982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:37.051857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-27a99a4f-755b-49ee-89ca-f82d27b58301 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/action" status: 200 len: 32 microversion: 2.1 time: 0.237651 Nov 02 12:33:37.052482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 257/531] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:36 2022] POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/action => generated 32 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:33:37.062290 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:37.063010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:37.069474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.070226 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.070877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.072017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.072706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.073295 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.286314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:37.301774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5f23ca2-d1c7-4344-9241-6d7c681cac55 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.243026 Nov 02 12:33:37.303366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 275/532] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:37 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:37.318604 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:37.319695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:37.330610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.331449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.332581 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.333379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.333835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.334433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.574621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:37.588753 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d8f094c8-4f5b-4cca-9e5d-ddd39ae9c88d tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.275388 Nov 02 12:33:37.589390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 258/533] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:37 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:37.971510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:37.973758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:37.980186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.980664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.981123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:37.981827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:37.982270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:37.982685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.015406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-499eedf6-9107-4b22-b9d3-71a1e243a1ba tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047876 Nov 02 12:33:38.016001 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 276/534] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:33:37 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:38.116094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.116637 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.124404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.125025 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.125567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.126673 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.127319 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.127877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.156568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:38.248168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-23db2d74-6422-4b66-bd6e-096ae39e9118 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 204 len: 0 microversion: 2.20 time: 0.136170 Nov 02 12:33:38.248887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 259/535] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Nov 2 12:33:38 2022] DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:33:38.266852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.268340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.280864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.282017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.282506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.283972 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.285527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.286282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.340812 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.342065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.351694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.352440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.353085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.354123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.354847 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.355534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.496515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.505846 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.507565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.509146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7f3d3cdf-b563-4dab-8bc3-4ae64c985466 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.251589 Nov 02 12:33:38.524521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 277/536] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:38.557628 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.566543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-23e51c3a-72a3-4f13-875f-54a91cc9db60 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.236564 Nov 02 12:33:38.567137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 260/537] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:38.627044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:38.627651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:38.633777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.634257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.634689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.635385 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:38.635832 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:38.636246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:38.781429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:38.790677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b39ded8c-a9ac-44dd-ada7-40084e111e36 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.167797 Nov 02 12:33:38.791253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 278/538] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:38 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:39.157502 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.158222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.167550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.168154 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.168706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.169686 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.170294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.171026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.264518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lazy-loading 'services' on Instance uuid 4b44e3d6-f0dc-46fd-9172-0f06d64e379b {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:39.346530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2880403a-6dfc-4d5d-bb43-c5f98c5826d5 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b/os-volume_attachments/57f6b50f-56d1-4a06-af27-1374be2f808c" status: 202 len: 0 microversion: 2.1 time: 0.194548 Nov 02 12:33:39.347400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 261/539] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:33:39 2022] DELETE /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b/os-volume_attachments/57f6b50f-56d1-4a06-af27-1374be2f808c => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:39.538790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.539406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.546325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.546821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.547259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.547987 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.548425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.548847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.554434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:39.595909 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.598596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.610011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.610879 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.611676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.614018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.614738 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.615306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.710723 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.720008 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.721473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.723172 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-42beec7e-1a52-476a-be1c-6a0434a92644 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.189406 Nov 02 12:33:39.723743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 279/540] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:33:39.808286 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:39.817335 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:39.817603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-243fc74c-dad5-4791-9d63-5d75f1fcc8ab tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.229400 Nov 02 12:33:39.818031 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 262/541] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:39.818431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:39.829515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.830364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.831151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:39.832390 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:39.833233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:39.833975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.025328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.035736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9e39a85a-4297-429d-bdfd-225387a8af84 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.224271 Nov 02 12:33:40.036513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 280/542] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:39 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:40.408860 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149aa06c-0add-4f04-b408-724d0d4f3e2e", "name": "network-vif-plugged", "status": "completed", "tag": "8f4d5990-9fd3-45f8-954e-96fc11468fac"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:40.421148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.421648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.422092 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.434752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] Creating event network-vif-plugged:8f4d5990-9fd3-45f8-954e-96fc11468fac for instance 149aa06c-0add-4f04-b408-724d0d4f3e2e on hv-cinder-86327 Nov 02 12:33:40.440369 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c3fa56ef-07bd-4f30-a6fd-b460ea582095 req-72b78002-1175-4284-98a0-7f46313f2c13 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035275 Nov 02 12:33:40.441537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 263/543] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:40.750344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:40.750944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:40.758641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.759124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.759773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.760491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.760941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.761396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.843012 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:40.843715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:40.850513 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.851005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.851430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.852509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:40.852961 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:40.853416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:40.940492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.950596 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.952127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:40.953360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ddbc884d-6118-4733-8361-4314620dd745 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1723 microversion: 2.20 time: 0.207067 Nov 02 12:33:40.954252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 281/544] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:40 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1723 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:41.061905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.062787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.069410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.069899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.070334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.071209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.071826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.072406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.158276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:41.167004 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6c773008-7c83-4e12-ac8b-5c8ebf6f1710 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.328214 Nov 02 12:33:41.167588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 264/545] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:40 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:41.207226 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:41.214985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1e1a7542-fea7-4c5f-ab4c-65854ca67bc5 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.158084 Nov 02 12:33:41.215558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 282/546] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:41.602799 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.604073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.611939 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.612251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.612714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.613627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.614296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.614722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.654424 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:41.655496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c684f91d-7d77-4303-99ad-d73b293539a4", "name": "network-vif-deleted", "tag": "76520876-ec20-4f93-afd1-a7ac9b9e2c3e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:41.666111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.666583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.667214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.683197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] Creating event network-vif-deleted:76520876-ec20-4f93-afd1-a7ac9b9e2c3e for instance c684f91d-7d77-4303-99ad-d73b293539a4 on hv-cinder-86327 Nov 02 12:33:41.688664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b1935615-8f3f-4b6a-88e0-3f2972650f6a req-2a00142d-d029-45d8-8795-85193af90028 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037000 Nov 02 12:33:41.689680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 283/547] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:33:41.761164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-54569554-391c-4a8a-a06a-215024d03b07 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 204 len: 0 microversion: 2.1 time: 0.162918 Nov 02 12:33:41.762044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 265/548] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:41 2022] DELETE /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:33:41.772049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.772749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.780740 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.781309 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.781745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.782458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.783081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.783668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.953420 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:41.964794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-35ca3e2a-ac1c-4d0d-aaee-0fcf940b1211 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1514 microversion: 2.1 time: 0.198351 Nov 02 12:33:41.965896 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 284/549] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1514 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:41.983934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:41.984749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:41.991869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.992380 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.992777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:41.993614 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:41.993991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:41.994404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.028617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.029130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.029582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.030042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'fault' on Instance uuid c684f91d-7d77-4303-99ad-d73b293539a4 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:42.077408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.086924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.088393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.089600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2ab138f8-5d51-47d5-b17b-ea797fb36388 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1372 microversion: 2.20 time: 0.110067 Nov 02 12:33:42.090156 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 266/550] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:41 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1372 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:42.192074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:42.193131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:42.202275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.203065 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.203794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.204465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.204917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.205371 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.239828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:42.241793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:42.247890 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.248373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.248804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.249603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.249983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.250405 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.397819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.420817 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-404abe96-f67e-4ef2-bc33-7031f970ed38 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.233115 Nov 02 12:33:42.421809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 285/551] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:42 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:42.424548 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:42.433946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-76abc7c9-7d15-4f0b-a173-b7c003b77c28 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.199416 Nov 02 12:33:42.443730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 267/552] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:42 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:42.988151 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:42.988763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:42.995576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.996059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.996496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:42.997250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:42.997733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:42.998129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.117396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:43.118678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:43.127013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.127599 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.128200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.128925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.129586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.130386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.174448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.175695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.176192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.176627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.177124 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'fault' on Instance uuid c684f91d-7d77-4303-99ad-d73b293539a4 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:43.188587 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1fa0f2f0-a047-4b99-9028-d20dad578815 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1514 microversion: 2.1 time: 0.204423 Nov 02 12:33:43.189233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 286/553] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:42 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:43.222630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.231375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.232830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.234070 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-09d83111-30c1-4ae1-aeec-ace1aeb3d04c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1372 microversion: 2.20 time: 0.122828 Nov 02 12:33:43.234641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 268/554] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:43 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1372 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:43.448339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:43.449079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:43.457590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.458256 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.458809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.459653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.460293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.460884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.464048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:43.465389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:43.477110 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.477981 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.478746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.480120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:43.484120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:43.484120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:43.773760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.790188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e7b0520b-ffa6-4349-9471-f9bc62cf5c25 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1315 microversion: 2.1 time: 0.334246 Nov 02 12:33:43.791516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 269/555] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:43 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1315 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:43.950492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:43.959917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-07a3b9c3-883d-4dae-8b9a-5509f06f4112 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.516321 Nov 02 12:33:43.960530 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 287/556] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:43 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:44.212570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.213215 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.219757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.220240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.220676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.221404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.221854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.222272 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.239153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=94,nova_cell1:UPDATE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:44.260242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.271584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.292877 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.293451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.293900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.295067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.295789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.296548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.340236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.341092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.341576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.342377 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'fault' on Instance uuid c684f91d-7d77-4303-99ad-d73b293539a4 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:44.388386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.399057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.400918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.405203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0835ba7d-318e-44c1-92b1-20620a725099 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 200 len: 1372 microversion: 2.20 time: 0.148129 Nov 02 12:33:44.406721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 288/557] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:33:44.515948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:44.525056 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a66f135f-106d-4a12-943f-f85476032ba0 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1514 microversion: 2.1 time: 0.316357 Nov 02 12:33:44.530243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 270/558] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1514 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:44.821403 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:44.822234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:44.829337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.830065 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.830383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.831149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.831558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.832062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.865825 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b44e3d6-f0dc-46fd-9172-0f06d64e379b", "name": "network-vif-deleted", "tag": "8e87082a-b161-4ab1-b5c5-6358ccc014b4"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:44.878245 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:44.879023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:44.879427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:44.896606 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] Creating event network-vif-deleted:8e87082a-b161-4ab1-b5c5-6358ccc014b4 for instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b on hv-cinder-86327 Nov 02 12:33:44.901569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-9e2ac927-4c86-4368-9cef-4522f0c06853 req-d422bc03-21f5-459c-8ef6-bcc443c82925 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040193 Nov 02 12:33:44.902880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 271/559] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:45.001384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.002281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.005155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:45.015361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.015876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1e96b313-a4fe-4053-896b-0aebed700617 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1465 microversion: 2.1 time: 0.199586 Nov 02 12:33:45.016062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.016341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 289/560] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1465 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:45.022859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.026780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.027918 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.029354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.077366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.077875 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.084185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.084786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.085526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.086230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.086692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.087505 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.118237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:33:45.205681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:45.216198 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5bdc38b5-4f93-41a7-9bb8-7e7eef4fcd27 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.219585 Nov 02 12:33:45.223908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 272/561] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:44 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:45.240093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-37798915-8df2-45ed-b778-c944b65269a2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "DELETE /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 204 len: 0 microversion: 2.1 time: 0.166285 Nov 02 12:33:45.240796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 290/562] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:33:45 2022] DELETE /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Nov 02 12:33:45.250043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.250659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.257614 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.258090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.258521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.259228 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.259677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.260096 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.405725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:45.417668 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4339d967-1cb8-44ea-a68f-db0f813816c2 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1471 microversion: 2.1 time: 0.171515 Nov 02 12:33:45.418524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 273/563] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:45 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1471 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:45.434527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.435271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.442216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.442786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.443324 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.444050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.444508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.444934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.460508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 HTTP/1.1 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:33:45.462213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:33:45.463633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'c684f91d-7d77-4303-99ad-d73b293539a4'} Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:45.464538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:33:45.465860 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:45.467091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:45.467091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-77562e8b-d846-45fa-a494-59a5da5cbf7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 404 len: 111 microversion: 2.20 time: 0.033390 Nov 02 12:33:45.467091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 291/564] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:45 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:33:45.473954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c9c31074-4fd4-4445-a23f-37e799d00667 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '.version_select at 0x7faf06982af0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.497806 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c9c31074-4fd4-4445-a23f-37e799d00667 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940074902" status: 204 len: 0 microversion: 2.20 time: 0.028240 Nov 02 12:33:45.498605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 274/565] 10.222.0.85 () {60 vars in 1262 bytes} [Wed Nov 2 12:33:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1940074902 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:33:45.547879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:45.548690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:45.554834 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.555315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.555742 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.556440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.556890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.557345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.591539 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:45.592144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:45.592580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:45.593057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lazy-loading 'fault' on Instance uuid 4b44e3d6-f0dc-46fd-9172-0f06d64e379b {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:45.652055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:45.659707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-514077d5-8250-4c29-937b-0e951c9afeab tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1309 microversion: 2.1 time: 0.115742 Nov 02 12:33:45.660275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 292/566] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:45 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1309 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:46.206756 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-02e1e7d7-3126-492e-ac9c-1bb623d4c5b8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: .version_select at 0x7faf06b3c550>, body: {"keypair": {"name": "tempest-keypair-17663316", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFkN7gf3yisnRA4woP3IW0ZnJHbp21RbNUmnR0CRL0e210NR2TUZjyWXdxY7K/nMpfmx1q1IxocH1+a6eJL/nhfZUn0CiIX3hi58bD15lLo9VfIHO33t5Rz+kwVEdNOuw=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:46.223345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-02e1e7d7-3126-492e-ac9c-1bb623d4c5b8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:46.227407 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-02e1e7d7-3126-492e-ac9c-1bb623d4c5b8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for user 83593f8338c444b7b117eeaf3e4cdcd5 and project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:46.241343 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.241963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.249656 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.250169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.250558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.251569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.252069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.252496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.253323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-02e1e7d7-3126-492e-ac9c-1bb623d4c5b8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.051069 Nov 02 12:33:46.254035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 275/567] 10.222.0.85 () {62 vars in 1200 bytes} [Wed Nov 2 12:33:46 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 53 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Nov 02 12:33:46.444216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.444934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.457161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.457161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.457161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.457161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.457603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.457603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.474924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.492312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8e8570df-e67e-48e4-b695-e10fcc34e5b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.254815 Nov 02 12:33:46.509722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 293/568] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:46.654067 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.662563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5a5922b6-0d07-4815-b16e-06b11be96032 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1471 microversion: 2.1 time: 0.224635 Nov 02 12:33:46.663218 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 276/569] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:46.684152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:46.684787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:46.691841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.692322 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.692770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.693487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.694413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.694413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.726851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:46.727320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:46.727747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:46.728184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lazy-loading 'fault' on Instance uuid 4b44e3d6-f0dc-46fd-9172-0f06d64e379b {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:46.731001 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:46.784206 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd655fb9352544adf8b3bac0cfa202d9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64af2cf0e0a14b3ea92c2438baeeb900', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:46.792056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6be13d31-509c-43fa-9b2f-b1e72f3fed3e tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 200 len: 1309 microversion: 2.1 time: 0.111907 Nov 02 12:33:46.793023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 294/570] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:46 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.518804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.520722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.528946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.530032 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.530715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.531682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.532363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.533188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.689564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.691246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.698446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.699042 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.699584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.700394 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.701199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.701749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.814795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:47.826815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3bb244f-8d0e-475a-afba-b2e82dd62e2c tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.312135 Nov 02 12:33:47.827866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 277/571] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:47.831088 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'deebae0bfcac4aa894d4c388d9f4f1e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76e1252062164975b8ac89f6181c4c4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:47.833515 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149aa06c-0add-4f04-b408-724d0d4f3e2e", "name": "network-vif-deleted", "tag": "8f4d5990-9fd3-45f8-954e-96fc11468fac"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:47.844328 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.844790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f29a387f-376b-4ca3-9b69-f76ef4b29aa3 tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 200 len: 1429 microversion: 2.1 time: 0.158499 Nov 02 12:33:47.844952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.845392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.847680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 295/572] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:47.859277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] Creating event network-vif-deleted:8f4d5990-9fd3-45f8-954e-96fc11468fac for instance 149aa06c-0add-4f04-b408-724d0d4f3e2e on hv-cinder-86327 Nov 02 12:33:47.864646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:47.866533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ace438f8-a0c3-497a-95f4-a79c4233376e req-24df9f39-de31-46a4-9dff-7c4fe19bd36e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037270 Nov 02 12:33:47.866653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] [instance: 4b44e3d6-f0dc-46fd-9172-0f06d64e379b] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:47.867659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 278/573] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:47.877098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.878299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.878967 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.879760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:47.880339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:47.880775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:47.897380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] HTTP exception thrown: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Request method failure captured: Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b HTTP/1.1 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmMg-fVqqA1OWy0zOGMv27WbSlHEepOcysD5LV6BLRjOFTeznndd75nqQOa_k1m9yMFKI8uNYY3AV2h-CBe4VASCF_cFjzBMpRpwoKQdztOw3nZTVZ3xOJhIeeEltOKpNAI0f-azhTAb2zDdHWvSDqlpnWCSzPWJVPuf6vjYYg_260Y Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 64af2cf0e0a14b3ea92c2438baeeb900 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:33:47.898912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/64af2cf0e0a14b3ea92c2438baeeb900"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 64af2cf0e0a14b3ea92c2438baeeb900 Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1078910471 Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesSnapshotTestJSON-1078910471-project Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: d655fb9352544adf8b3bac0cfa202d9e Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesSnapshotTestJSON-1078910471-project Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. Nov 02 12:33:47.900509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '4b44e3d6-f0dc-46fd-9172-0f06d64e379b'} Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:47.901460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. Nov 02 12:33:47.902881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:47.904944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] Returning 404 to user: Instance 4b44e3d6-f0dc-46fd-9172-0f06d64e379b could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:47.905989 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7a262789-5282-4493-b63f-2c6f76c340f8 tempest-VolumesSnapshotTestJSON-1078910471 tempest-VolumesSnapshotTestJSON-1078910471-project] 10.222.0.85 "GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b" status: 404 len: 111 microversion: 2.1 time: 0.057141 Nov 02 12:33:47.906716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 296/574] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:47 2022] GET /compute/v2.1/servers/4b44e3d6-f0dc-46fd-9172-0f06d64e379b => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:47.971904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2085886139", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "06c5d739-a69b-4eff-a51e-383faef760f9"}], "security_groups": [{"name": "tempest-securitygroup--311725818"}], "key_name": "tempest-keypair-17663316", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:48.082878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] validate_networks() for [('06c5d739-a69b-4eff-a51e-383faef760f9', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:33:48.515789 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:33:48.516207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:33:48.516667 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:33:48.517306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:33:48.517926 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:33:48.528600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.529892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.530331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.531137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.531590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.532204 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.545553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:48.555512 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:33:48.561108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Getting quotas for user 83593f8338c444b7b117eeaf3e4cdcd5 and project 62aa5934d5d14fdb81dd5d4817ab8e74. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:33:48.576308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:33:48.579413 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:33:48.636083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ac4e60e-c635-40c4-bd9d-a97c81b6b8e7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.666249 Nov 02 12:33:48.636083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 279/575] 10.222.0.85 () {62 vars in 1188 bytes} [Wed Nov 2 12:33:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Nov 02 12:33:48.651317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.652094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.729761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.744136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.747453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:48.749701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f15f753f-d128-4b56-871f-a4c6ec830d7b tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1280 microversion: 2.20 time: 0.102675 Nov 02 12:33:48.750775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 297/576] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1280 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:33:48.854803 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.855452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.862220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.862728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.863233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.863871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.864333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.864752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.880453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:48.881583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] [instance: 149aa06c-0add-4f04-b408-724d0d4f3e2e] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:48.895841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.896778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.897585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.898868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:48.900245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:48.900780 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:48.928415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] HTTP exception thrown: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Request method failure captured: Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e HTTP/1.1 Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmOS-Lhja9xqQFj6ya0r-IVDBp8CFOtSJ06vD0KbdLcRm3iyHKRG5UCoqdKPRhTyYxO5qfIi6XCuyz6owbqdjmNGaACk0ma1_PuQMLh01iGVqXrfYn6WB6lZUkvxgItJjZphgKpyKxL7UuxfKsg5wepb2Scmxrn1mRSzARYADHp_71U Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 76e1252062164975b8ac89f6181c4c4d Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-VolumesNegativeTest-1150319469 Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:33:48.931575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_76e1252062164975b8ac89f6181c4c4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/76e1252062164975b8ac89f6181c4c4d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/76e1252062164975b8ac89f6181c4c4d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/76e1252062164975b8ac89f6181c4c4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-VolumesNegativeTest-1150319469 Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 76e1252062164975b8ac89f6181c4c4d Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-VolumesNegativeTest-1150319469 Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-VolumesNegativeTest-1150319469-project Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: deebae0bfcac4aa894d4c388d9f4f1e3 Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-VolumesNegativeTest-1150319469-project Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. Nov 02 12:33:48.932956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '149aa06c-0add-4f04-b408-724d0d4f3e2e'} Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:48.934038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. Nov 02 12:33:48.936041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:33:48.937158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] Returning 404 to user: Instance 149aa06c-0add-4f04-b408-724d0d4f3e2e could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:48.937158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11239171-5266-41ad-9d2c-e8116ab623cb tempest-VolumesNegativeTest-1150319469 tempest-VolumesNegativeTest-1150319469-project] 10.222.0.85 "GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e" status: 404 len: 111 microversion: 2.1 time: 0.059309 Nov 02 12:33:48.937158 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 298/577] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/149aa06c-0add-4f04-b408-724d0d4f3e2e => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:33:49.070780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.080595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d3e87e18-2114-461c-b64c-37b44ddc0f9e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.229608 Nov 02 12:33:49.081436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 280/578] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:48 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:49.777707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:49.778310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:49.786285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.786895 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.787325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.788311 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:49.788932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:49.789380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:49.854798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.863439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.864892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:49.866137 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-41ce5f22-e35d-4315-95c7-6f4d90f12873 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1332 microversion: 2.20 time: 0.092809 Nov 02 12:33:49.866675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 299/579] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:49 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:50.104727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:50.105373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:50.112965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.113593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.113916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.114623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.115068 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.115490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.259322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.269865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd5b7214-558d-4015-9a55-d3b478d93372 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.168822 Nov 02 12:33:50.270625 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 281/580] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:50 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:50.891873 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:50.892483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:50.900554 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.901076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.901518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.902224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:50.903203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:50.903203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:50.980729 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.995275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.997348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:50.999069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-50b39298-679d-448c-a1b9-c53b007611a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1332 microversion: 2.20 time: 0.110826 Nov 02 12:33:50.999963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 300/581] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:50 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:51.294180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:51.294798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:51.301734 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.302217 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.302644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.303330 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.303778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.304195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.485145 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:51.496011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f1b14748-21a9-4385-92a9-ff07c4cd3b06 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.205585 Nov 02 12:33:51.496681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 282/582] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:51 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:51.551076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:51.551571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:51.557937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.558418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.559020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.559916 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:51.560360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:51.560769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:51.657731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lazy-loading 'services' on Instance uuid 4e473906-98d3-4493-8449-d57838bdae8f {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:33:51.742488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b8fc712f-799e-4d3f-bae7-c8a044817712 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments/aefba506-383c-468c-8a7d-f5ea7921ff82" status: 202 len: 0 microversion: 2.1 time: 0.197545 Nov 02 12:33:51.743077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 301/583] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:33:51 2022] DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments/aefba506-383c-468c-8a7d-f5ea7921ff82 => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:52.046655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:52.047783 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:52.056119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.056763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.057289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.058289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.058847 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.059275 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.124255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.132958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.134402 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.135489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4ba0fd3c-50f9-44b9-bc05-6e96b8edab34 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1332 microversion: 2.20 time: 0.096531 Nov 02 12:33:52.136043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 283/584] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:52 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1332 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:52.522096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:52.522806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:52.529385 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.529881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.530318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.531049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:52.531489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:52.531909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:52.707929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:52.723020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7f02c270-80b4-4439-9dae-20d560381476 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.205122 Nov 02 12:33:52.724212 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 302/585] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:52 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:53.162558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:53.163193 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:53.173223 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.173712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.174146 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.175002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.175627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.176051 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.320761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:53.339516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:53.342980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:53.345494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-909b2df2-0006-4404-b94a-4230cc67bdef tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1338 microversion: 2.20 time: 0.188383 Nov 02 12:33:53.361357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 284/586] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:53 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:53.750701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:53.752421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:53.759870 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.760498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.760938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:53.762037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:53.762567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:53.763186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.006656 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.037329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9304086a-6ab8-495e-8932-a35b3b829fdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.290926 Nov 02 12:33:54.038677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 303/587] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:53 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:54.041611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:54.048042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.049161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.049814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.074973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Going to try to stop instance {{(pid=120740) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Nov 02 12:33:54.126879 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b4112307-e7eb-465b-b677-eb8907a2078b tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action" status: 202 len: 0 microversion: 2.1 time: 0.095250 Nov 02 12:33:54.132816 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 285/588] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:54 2022] POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:54.141600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:54.142274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:54.151677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.153344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.154615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.155729 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.156636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.157099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.392167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:54.393616 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:54.407858 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.408366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.411487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.412661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:54.413175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:54.413602 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:54.414503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.433594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8e583149-a2b6-4bff-87d6-0e8407f67f27 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.293730 Nov 02 12:33:54.435986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 304/589] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:54 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:54.767914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.780430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.782955 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:54.784491 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-93d10cd2-146f-44af-ae8e-e2031a7572d8 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.397200 Nov 02 12:33:54.785357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 286/590] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:54 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:55.078104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:55.078864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:55.086805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.087391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.088168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.088929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.089549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.090050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.270768 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:55.290784 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.296935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.302475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.303163 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.313745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22f1bf41-03e9-4b09-91d6-391e18f0514a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1733 microversion: 2.1 time: 0.239493 Nov 02 12:33:55.314748 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 305/591] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:55 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:55.329324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] Creating event network-changed:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:33:55.339830 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-2f06da8d-8f29-4bbb-aee1-053a539f633a req-574169e5-8269-4a57-b23a-123a5dddbaf7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076675 Nov 02 12:33:55.341750 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 287/592] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:33:55.474136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:55.475393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:55.482316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.483116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.483699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.484567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.485126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.485662 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.647520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:55.657356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4e6be2d0-a139-463c-832c-3e3694c0e92f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.195111 Nov 02 12:33:55.657993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 306/593] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:55 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:55.829950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:55.831356 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:55.837890 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.838058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.838490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:55.839787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:55.840403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:55.840988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.089548 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.098547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.100931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.102856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-244271e5-0834-434a-9b53-958209ccb4bc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.278131 Nov 02 12:33:56.103878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 288/594] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:55 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:56.340933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.341723 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.348773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.349816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.350114 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.350927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.351549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.352066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.496925 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.507135 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ce9ba24a-9d11-41b9-bcfd-35d851b95534 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1713 microversion: 2.1 time: 0.170416 Nov 02 12:33:56.507735 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 307/595] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1713 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:56.624460 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.624952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.631880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.632362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.632796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.633517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.633980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.634393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.684025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.684630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.691768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.692253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.692684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.693420 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.693871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.694289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.726240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] HTTP exception thrown: Cannot 'detach_volume' instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 while it is in vm_state rescued Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Request method failure captured: Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments/cb344411-e26c-4c5f-83f6-5308b8929365 HTTP/1.1 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKZnW8x3KSJFcsvcZjFTbd7Fbs_YppMYEpFh43nUxOdEojqzUzC551yaMAYnRscT9N5AXqoUygfBN3itwprc-l3gH6g-a-s1ILC4w9jlR7yatBHg-X7K5E8DAvMfhsu5CiRVxx_V6ylfFGdbPevnUFf1cT3KFx4670yeolY7Ri2ZyU Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:33:56.727983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 7c5ccd8c99934f60b4ca26c4990b7412 Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:33:56.729557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Cannot 'detach_volume' instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 while it is in vm_state rescued Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'server_id': 'd421a0ad-d6ba-492d-9d77-90d12500d3e6', 'id': 'cb344411-e26c-4c5f-83f6-5308b8929365'} Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 in vm_state rescued. Cannot detach_volume while the instance is in this state. Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:33:56.730428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 while it is in vm_state rescued Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 while it is in vm_state rescued Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:33:56.732041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Returning 409 to user: Cannot 'detach_volume' instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 while it is in vm_state rescued {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:33:56.733085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2f3ddd1e-22d9-4d13-9aec-2dd7a26f35c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments/cb344411-e26c-4c5f-83f6-5308b8929365" status: 409 len: 152 microversion: 2.1 time: 0.110289 Nov 02 12:33:56.733085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 289/596] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:33:56 2022] DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments/cb344411-e26c-4c5f-83f6-5308b8929365 => generated 152 bytes in 113 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Nov 02 12:33:56.743294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:33:56.743921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.750962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.751453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.751880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.753229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.753677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.754093 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.793701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:56.863216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:56.865700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-65487a27-418b-4609-a76e-5ddb110f15e2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/action" status: 202 len: 0 microversion: 2.1 time: 0.125765 Nov 02 12:33:56.869046 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 290/597] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:33:56 2022] POST /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:33:56.872584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0341b599-a853-44a7-91b5-a048504a2220 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.192303 Nov 02 12:33:56.873199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 308/598] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:56.879324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:56.880605 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:56.892757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.893494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.894349 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:56.895691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:56.896509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:56.897322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.050887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:57.059537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1d8cbade-ae4e-4724-8b07-0883b271f8ca tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.187540 Nov 02 12:33:57.060183 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 291/599] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:56 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:33:57.131563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:57.132807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:57.134847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:57.142810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.143578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.144013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.144917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.145670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.146073 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.406798 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:57.416145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:57.417888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:57.419111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bf61b5bf-f84b-4f10-934e-95deda5569a3 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.292001 Nov 02 12:33:57.419893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 309/600] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:57 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:57.911826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:57.912438 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:57.918943 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.919427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.919869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:57.920554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:57.921015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:57.921600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.053417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.061263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-80e2e03d-a26f-4b8d-84f7-eecdc183151d tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.153833 Nov 02 12:33:58.061844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 292/601] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:57 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:58.084246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.084853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:58.090941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.091420 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.091850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.092540 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.092985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.093423 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.233986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.243266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f8a5f37f-0686-40f9-b48c-ddb84c9dab5b tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.163203 Nov 02 12:33:58.244104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 310/602] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:58.445289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:58.445891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:58.451994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.452474 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.452905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.453617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:58.454066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:58.454490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:58.540921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:58.570942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=10 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:58.597160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.605708 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.607144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:58.608258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9e975513-506c-423a-a1df-cc4de828fd38 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.167269 Nov 02 12:33:58.608817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 293/603] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:58 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:33:59.084481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:59.085127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:59.087498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:59.093855 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.094842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.095368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.096093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.096535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.096956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.225919 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:59.233632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e65afcba-f21d-40bf-a6c6-955504fe2fce tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.153747 Nov 02 12:33:59.234205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 311/604] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:59 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:59.269515 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:59.270406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:59.276332 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.276821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.277287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.278007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.278441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.278868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.455927 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:59.466488 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-30af46c3-82e7-430f-bb73-f42830090c63 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.201209 Nov 02 12:33:59.467524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 294/605] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:33:59 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:33:59.636445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:33:59.637123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:33:59.644485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.644485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.645041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.646900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:33:59.646900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:33:59.646900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:33:59.805387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:59.807822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:33:59.816619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:59.818235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:33:59.819402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c3772766-8661-4ffd-8ec5-ff947d6d5a49 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.186954 Nov 02 12:33:59.820015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 312/606] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:33:59 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:00.258417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:00.259342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:00.265652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.266128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.266553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:00.267240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.267685 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.268101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:00.492248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:00.493257 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:00.501058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.501789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.502508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:00.503610 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.504121 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.504566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:00.736025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:00.743766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:00.750578 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-070213c9-fa42-4ccf-aa4f-68d8b8a756c7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.262157 Nov 02 12:34:00.752109 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 313/607] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:00 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:00.779810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a83635da-0fa1-4474-bf93-7b56d7c300ca tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.525162 Nov 02 12:34:00.783849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 295/608] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:00 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:00.847022 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:00.847556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:00.855112 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.855626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.856110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:00.857219 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:00.857765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:00.858370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.055353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.064029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.065528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.066760 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0fe92272-4bad-4ad1-84ee-42480627cfb6 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.224244 Nov 02 12:34:01.067337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 314/609] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:00 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:01.779403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:01.780020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:01.786582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.787087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.787523 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.788226 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.788679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.789132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.803643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:01.804310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:01.810855 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.811340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.811770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.812488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:01.812935 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:01.813392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:01.934942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.944934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-62dd8987-24a4-4841-a99f-0702964492ae tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.169177 Nov 02 12:34:01.945813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 296/610] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:01 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:01.970513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:01.979211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1de58f73-fcc6-4c06-bf11-1f051cc8d726 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.179959 Nov 02 12:34:01.979803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 315/611] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:01 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:02.092515 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:02.093064 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:02.099307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.099789 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.100222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.100923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.101408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.101835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.229268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.237509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.238957 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:02.240052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f85398e4-1a3c-404f-bec6-101af124d842 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.151678 Nov 02 12:34:02.240639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 297/612] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:02.971545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:02.972163 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:02.978890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.979307 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.979743 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:02.980451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:02.980903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:02.981351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.005231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:03.005843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:03.011929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.012404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.012838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.013564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.014014 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.014461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.118694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.127304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0c0cae80-20f6-498a-9e21-a9b71dc2db5a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.160350 Nov 02 12:34:03.127881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 316/613] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:03.155818 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.164579 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8a53ccb7-0a02-4478-8883-cb639c1490df tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.164131 Nov 02 12:34:03.165229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 298/614] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:02 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:03.266722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:03.267251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:03.274045 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.274534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.274995 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.275692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:03.276142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:03.276569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:03.405214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.414065 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.415529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:03.416661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-81202885-568d-4ab0-abbc-bf15eee222cb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.154658 Nov 02 12:34:03.417261 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 317/615] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:03 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:04.151307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:04.151834 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:04.158445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.158921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.159350 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.160275 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.160721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.161216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.188490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:04.189421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:04.197924 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.198533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.199100 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.200054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.200664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.201210 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.319836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:04.328654 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9b054d23-e2e6-4c6d-9afe-5b3f84ee1cbf tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1721 microversion: 2.1 time: 0.181549 Nov 02 12:34:04.329385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 299/616] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:04 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:04.334270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:04.343599 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.344279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.345204 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.356817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] Creating event network-vif-plugged:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:34:04.357488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:04.362339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-02023d29-a6c8-4901-a6d9-27a55049ea40 req-0dc32417-2842-40d0-b510-f89b3d9926cf service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031223 Nov 02 12:34:04.362932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 300/617] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:04.367715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d79106a1-32e8-402d-9630-4199ee7d9ec4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.183176 Nov 02 12:34:04.368349 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 318/618] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:04 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:04.442983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:04.443303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:04.449627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.450111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.450540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.451259 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:04.451710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:04.452128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:04.589435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:04.598453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:04.599928 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:04.601358 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1429169e-7480-4582-9143-bbb53dd06fe1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.163034 Nov 02 12:34:04.610710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 301/619] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:04 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:05.352863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.354859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.360282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.360770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.361851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.362610 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.363150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.363569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.392867 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.393746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.402049 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.402721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.403411 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.404391 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.405075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.405663 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.562410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.579640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-76cf39f1-4536-4a61-b597-07b006ed1882 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1727 microversion: 2.1 time: 0.230445 Nov 02 12:34:05.581194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 319/620] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1727 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:05.624722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.626634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.637564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:05.639391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.640571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.641663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.642971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.644044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.645134 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.649212 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b3657365-4770-4b94-aa61-a8c190e4396f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.259897 Nov 02 12:34:05.650287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 302/621] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:05.655869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:05.656483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:05.665327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.666089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.666711 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.667641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:05.668263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:05.668836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:05.785970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0490b9f2-7ea3-4b7b-980a-3388993da331 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169143 Nov 02 12:34:05.787386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 320/622] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-interface => generated 284 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:06.003060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:06.041392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:06.063049 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:06.066164 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-600f64d4-ed35-4813-a2cf-5c76004ab377 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.414245 Nov 02 12:34:06.067233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 303/623] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:05 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:06.690120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:06.691480 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:06.695273 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:34:06.695684 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Wed Nov 2 12:34:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f (ip 10.222.0.85) !!! Nov 02 12:34:06.701958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:06.702412 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:06.703030 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:06.703976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:06.704444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:06.705087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.093291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:07.093952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:07.104560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.106372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.107723 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.108702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.110357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.111275 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.235500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.244831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0a315d66-67bc-4e3f-9a49-7cccff6eb718 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.559031 Nov 02 12:34:07.245469 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 321/624] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:06 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:07.296562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.305650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.307100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:07.308210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5d140529-fc27-49b1-9662-94c2af28f07d tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1405 microversion: 2.20 time: 0.219406 Nov 02 12:34:07.308775 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 304/625] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:07 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1405 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:07.412739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:07.424176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:07.424837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:07.425413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:07.441252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] Creating event network-changed:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:34:07.447807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-f70b15c9-2233-4b1d-b570-91346e8b3fe6 req-8cccf1c7-c283-4fd8-a6b0-07a6ec364479 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046377 Nov 02 12:34:07.448548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 322/626] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:08.269536 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.270174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:08.276318 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.276802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.277262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.277957 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.278404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.278828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.338141 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.339043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:08.345961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.346559 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.347234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.348194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.348697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.349227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.429361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.438065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c8bc2deb-10bf-4a14-874f-fbccb977d620 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.172983 Nov 02 12:34:08.439088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 305/627] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:08.504593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.513281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.514825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:08.515885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25ef49f3-5802-4a11-b2a7-3cc07c38105e tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1597 microversion: 2.20 time: 0.182872 Nov 02 12:34:08.516473 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 323/628] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1597 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:08.542123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:08.542630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:08.548980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.549715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.550150 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.550854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:08.551308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:08.551726 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:08.639510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5b09ae43-ca6a-4f69-a51c-dd3b3ec8a8ed tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.101383 Nov 02 12:34:08.640176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 306/629] 10.222.0.85 () {60 vars in 1316 bytes} [Wed Nov 2 12:34:08 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:34:09.467117 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:09.469596 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:09.476333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:09.483060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:09.483544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:09.483975 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:09.484682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:09.485169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:09.485593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:09.487660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:09.488335 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:09.489062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:09.502856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] Creating event network-changed:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:34:09.508053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-812e6c64-3738-4c29-be91-31aa6f9b035f req-344aad17-ae32-440f-b4be-e31bf041d7e7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045758 Nov 02 12:34:09.508678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 307/630] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:09.630283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:09.638279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9478b601-eaa2-4ac4-af37-ebc9d80203b8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1678 microversion: 2.1 time: 0.180355 Nov 02 12:34:09.638856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 324/631] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:09 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1678 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:10.128729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:10.138445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.139006 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.139527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.143651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:10.152876 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] Creating event network-changed:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:34:10.158102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-57b1cc3d-423b-4212-a11c-5a4ac4d114da req-12325a34-66ea-4e37-9e8e-f0c33e034dc2 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034560 Nov 02 12:34:10.159000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 308/632] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:10.664527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:10.665612 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:10.673576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.674470 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.674920 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.675757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.676836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.677482 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.856329 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:10.880136 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c7876ace-32b7-464c-a889-02533bebb1ae tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1655 microversion: 2.1 time: 0.220581 Nov 02 12:34:10.880763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 325/633] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:10 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1655 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:10.920254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:10.930982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:10.931485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:10.931915 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:10.956582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Going to try to start instance {{(pid=120740) start /opt/stack/nova/nova/compute/api.py:2785}} Nov 02 12:34:11.004009 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f93b9a61-a680-4bf4-bb1f-ca46f5b0a4c5 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action" status: 202 len: 0 microversion: 2.1 time: 0.101536 Nov 02 12:34:11.004822 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 309/634] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:34:10 2022] POST /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/action => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:11.016969 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:11.018398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:11.050200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.050733 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.051189 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:11.051916 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:11.052371 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:11.052797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:11.212319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:11.226245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a54e08b7-8cb2-4d9f-afd2-693e05f3521f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1664 microversion: 2.1 time: 0.216881 Nov 02 12:34:11.227582 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 326/635] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:11 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1664 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:12.253681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:12.254385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:12.260727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:12.261600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:12.261871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:12.262431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:12.262884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:12.263305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:12.443359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:12.453613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b987ec79-369b-40df-9744-25c1897bc978 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1664 microversion: 2.1 time: 0.205489 Nov 02 12:34:12.454760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 310/636] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:12 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1664 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:13.485245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:13.485245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:13.490782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.491264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.491690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:13.492662 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:13.493146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:13.493563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:13.643929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:13.652236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d9b161d0-b8da-4df2-94ef-69bb4bcaf810 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1668 microversion: 2.1 time: 0.173680 Nov 02 12:34:13.652825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 327/637] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:13 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1668 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:32.959366 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:32.959966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:32.963469 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:32.964334 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:32.971639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:32.972125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:32.972550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:32.973281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:32.973729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:32.974144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:32.999427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lazy-loading 'flavor' on Instance uuid b59ad8ab-195e-4736-8bb9-c44d17f23e5c {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:33.079684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a50f3dab-37f9-410f-9a8d-57b4b53915e9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "POST /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.123528 Nov 02 12:34:33.080357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 311/638] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:34:32 2022] POST /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:33.089851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:33.090717 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:33.093640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=37 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:33.096422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=85 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:33.100677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:33.101269 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:33.101761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:33.102546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:33.103043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:33.103478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:33.255387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:33.263373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0cba7946-f492-4d5a-836b-f423911c921a tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.177789 Nov 02 12:34:33.263998 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 328/639] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:33 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:34.289294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:34.289996 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:34.296895 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:34.297528 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:34.297964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:34.298670 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:34.299122 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:34.299545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:34.458838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:34.468360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-14557246-765b-40be-90e5-30f08d5fdee9 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.183606 Nov 02 12:34:34.470373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 312/640] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:34 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:35.493563 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:35.494185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:35.501784 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.502266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.502706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.503417 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:35.503872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:35.504296 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:35.650224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:35.660452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9418d0b3-2f10-4d67-b1d1-70e50be8276c tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.170696 Nov 02 12:34:35.661065 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 329/641] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:35 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:36.684305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:36.684929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:36.692489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:36.692975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:36.693431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:36.694136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:36.694584 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:36.695004 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:36.838074 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:36.846521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bec1e598-8150-4f8a-9a3a-43181f506436 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.165992 Nov 02 12:34:36.847112 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 313/642] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:36 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:37.869463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:37.870068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:37.877611 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:37.878089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:37.878520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:37.879214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:37.879667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:37.880084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:38.018714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:38.026642 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f135d680-6113-4a2d-904e-b4f5f43cfc60 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.160966 Nov 02 12:34:38.027223 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 330/643] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:37 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:39.051216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:39.051828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:39.058506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:39.059013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:39.059445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:39.060143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:39.060590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:39.061022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:39.207339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:39.215518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-af99389c-1178-42d3-b9ce-5a4d2532be30 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.168712 Nov 02 12:34:39.216095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 314/644] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:39 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:40.240112 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:40.240725 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:40.247211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:40.247690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:40.248124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:40.248819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:40.249300 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:40.249721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:40.390176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:40.399114 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2464630d-6f00-4be5-b498-9721a5d45b50 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.163118 Nov 02 12:34:40.399699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 331/645] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:40 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:41.423966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:41.424582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:41.431701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.432168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.432592 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.433347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:41.433923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:41.434339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:41.575087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:41.583640 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6a5c123f-3228-4d0e-bc9d-cc5a76192ad4 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.164759 Nov 02 12:34:41.584215 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 315/646] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:41 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:42.606825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:42.607426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:42.613985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:42.614459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:42.614886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:42.615636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:42.616076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:42.616489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:42.756073 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:42.765167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4540c208-0cdb-4ecc-9368-9a6b8748fde2 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.161986 Nov 02 12:34:42.766319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 332/647] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:42 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:43.789960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:43.790577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:43.797593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.798079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.798509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:43.799205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:43.799656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:43.800076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:44.280331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:44.288965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df8fc3e9-3a77-4c14-81f1-c52661a11129 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.502759 Nov 02 12:34:44.289929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 316/648] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:43 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:45.311910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:45.312509 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:45.319188 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.319673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.320110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.320815 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.321464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.321892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.430157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:45.430905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:45.437792 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.438285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.438719 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.439632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.440106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.440531 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.478856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:45.486974 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3413bb51-dbb1-4b7f-9d0c-7c5ba8897950 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.178909 Nov 02 12:34:45.487560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 333/649] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:45 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:45.527185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'services' on Instance uuid d421a0ad-d6ba-492d-9d77-90d12500d3e6 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:45.601837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3a4cf536-535c-4fb2-b371-263708cd38f9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments/cb344411-e26c-4c5f-83f6-5308b8929365" status: 202 len: 0 microversion: 2.1 time: 0.175577 Nov 02 12:34:45.602426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 317/650] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:34:45 2022] DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments/cb344411-e26c-4c5f-83f6-5308b8929365 => generated 0 bytes in 177 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:34:45.610825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:45.613119 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:45.619394 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.620090 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.620529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.621356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:45.621959 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:45.622338 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:45.654425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49346bb0-155d-4529-860e-ddb512739847 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047515 Nov 02 12:34:45.654999 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 334/651] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:34:45 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:46.511849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.512268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.518653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.519385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.519899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.520653 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.521137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.521559 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.700182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:46.709427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a5059e5d-a421-4608-8cfa-5cb461ca7d5e tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.202448 Nov 02 12:34:46.721445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 318/652] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:46 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:46.732019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.734401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.741020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.741570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.741941 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.742638 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.743281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.743814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.767300 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.768433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.774963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.775551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.775984 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.776691 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.777195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.777585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.783875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ed07610c-8c57-4dca-8d05-2732e84b406a tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061229 Nov 02 12:34:46.784560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 319/653] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:34:46 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6/os-volume_attachments => generated 25 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:34:46.807157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-afde953f-8764-48f3-996c-8d727260ecf9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/ips" status: 200 len: 152 microversion: 2.20 time: 0.273800 Nov 02 12:34:46.808004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 335/654] 10.222.0.85 () {60 vars in 1289 bytes} [Wed Nov 2 12:34:46 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/ips => generated 152 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Nov 02 12:34:46.874496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:46.876188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:46.882304 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.883036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.883466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.884160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:46.884604 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:46.885043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:46.911973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:34:47.011347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd132005-1a08-4709-9a1b-d55207caffcd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 204 len: 0 microversion: 2.1 time: 0.140729 Nov 02 12:34:47.013257 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 320/655] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:34:46 2022] DELETE /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:47.023891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:47.024542 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:47.032525 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.033546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.034152 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.035071 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.035615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.036330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.208169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:47.215871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ccfa86c-532e-46e0-974d-3381b3563469 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1687 microversion: 2.1 time: 0.197579 Nov 02 12:34:47.216441 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 336/656] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:47 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1687 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:47.738494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:47.739131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:47.745406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.745879 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.746307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.746985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.747430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.747851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.883540 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:47.892794 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-713c8752-bcf7-41e6-967e-ed470a48c080 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1570 microversion: 2.1 time: 0.158627 Nov 02 12:34:47.893420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 321/657] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:47 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1570 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:47.916483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:47.917147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:47.923722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.924227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.924661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:47.925379 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:47.925826 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:47.926236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.020035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120739) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:34:48.086314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08a0ecb7-9541-4e30-b420-253625c009a7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "POST /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c/action" status: 202 len: 0 microversion: 2.1 time: 0.174346 Nov 02 12:34:48.087045 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 337/658] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:34:47 2022] POST /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:48.095013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:48.095624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:48.101702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.102191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.102632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.103331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.103787 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.104207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.240598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:48.241342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:48.247524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.247992 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.248510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.249309 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:48.250701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:48.251171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:48.308352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:48.324089 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-709d591b-13b2-4653-8331-30ae87ede342 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1578 microversion: 2.1 time: 0.232496 Nov 02 12:34:48.325312 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 322/659] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:48 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:48.396383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:48.404345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a6eb27bf-dd40-4cef-bdf4-5d2aa790f8e7 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1687 microversion: 2.1 time: 0.168138 Nov 02 12:34:48.404921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 338/660] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:48 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:49.350646 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.351307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.357740 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.358218 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.358647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.359992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.360443 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.360977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.365173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:49.429146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.429884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.436484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.436960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.437482 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.438194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.438648 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.439077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.514313 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.522836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-24f15fad-19f3-40c3-b6c6-48eb8cf979a0 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1578 microversion: 2.1 time: 0.175979 Nov 02 12:34:49.523413 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 323/661] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1578 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:49.528099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:49.529425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.536461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.537139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.537769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.538331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.538924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.539375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.564251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lazy-loading 'flavor' on Instance uuid f036557f-8699-4d06-ad2e-8c113952f2c4 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:49.583933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.592433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c79a8dce-60b8-4b70-aeef-93d41964d1d9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1687 microversion: 2.1 time: 0.167162 Nov 02 12:34:49.594000 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 339/662] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1687 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:49.775446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7f9dd625-bafb-4e86-807d-1a2e97cb7439 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/action" status: 202 len: 0 microversion: 2.20 time: 0.250836 Nov 02 12:34:49.776039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 324/663] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Nov 2 12:34:49 2022] POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:49.784896 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:49.785529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:49.791540 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.792020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.792457 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.793180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:49.793632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:49.794053 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:49.935864 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.946426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.948287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:49.949731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-25a70cf4-b8cf-4278-a6db-4c862296bd99 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.169235 Nov 02 12:34:49.950586 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 340/664] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:49 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:50.319918 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "name": "network-vif-unplugged", "status": "completed", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:50.332162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.333042 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.333667 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.347231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] Creating event network-vif-unplugged:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:34:50.353434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-fa622788-280e-486d-b46f-09391871e20d req-357fac88-b8a2-4de4-bee8-d19c96576eb0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038124 Nov 02 12:34:50.354361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 325/665] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:50.547265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.548029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.554912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.555438 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.555897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.556626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.557203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.557630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.617907 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.618888 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.628556 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.629078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.629517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.630247 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.630691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.631111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.732701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.742310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ae959608-25ce-4dc9-a72c-42262f1a21bb tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1578 microversion: 2.1 time: 0.199405 Nov 02 12:34:50.743774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 341/666] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1578 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:50.823350 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:50.832236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2dd5bfb1-815a-4ae5-a5de-470a8894d544 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1687 microversion: 2.1 time: 0.219264 Nov 02 12:34:50.832818 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 326/667] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1687 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:50.978250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:50.979026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:50.989075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.989711 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.990161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:50.992524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:50.993259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:50.993707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.150110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.160054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.161655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.163544 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-05243a58-6e4d-42e4-a3cc-6077c9531293 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.189031 Nov 02 12:34:51.175633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 342/668] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:50 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:51.769934 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.770672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.778742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.779340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.780441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.782033 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.782733 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.783404 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.857696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:51.859005 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:51.867850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.869267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.869846 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.870865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:51.871613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:51.872391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:51.947566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:51.960531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:51.967066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-67685047-654e-4f1e-92bb-e82237514e3e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1619 microversion: 2.1 time: 0.113454 Nov 02 12:34:51.967655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 343/669] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1619 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:52.003131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.012682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c2778404-66b1-49fc-bfc6-89beabae32f5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1520 microversion: 2.1 time: 0.246427 Nov 02 12:34:52.025062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 327/670] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:51 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1520 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:52.190774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.191668 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.204358 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.205184 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.205786 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.206743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.207550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.208194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.274305 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d421a0ad-d6ba-492d-9d77-90d12500d3e6", "name": "network-vif-deleted", "tag": "31851f55-682f-47de-8743-7d17731aefbf"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:52.285476 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.286004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.286511 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.305845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] Creating event network-vif-deleted:31851f55-682f-47de-8743-7d17731aefbf for instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 on hv-cinder-86327 Nov 02 12:34:52.315609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b3f86659-47a4-47ef-b83e-15689c4b76dc req-5fba55a2-e431-4bb7-9fcb-0d8c0b2d91c7 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149961 Nov 02 12:34:52.316677 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 344/671] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:34:52.392814 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.415633 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.418671 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:52.420320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-820f27a2-9718-45e4-a49d-2cd7562e6ad5 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.233703 Nov 02 12:34:52.422142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 328/672] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:52.480407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.484081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.492029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.492536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.493049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.493869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.494337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.494759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.535755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2b36025d-2b9e-4628-abac-2490dafc5a62 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062268 Nov 02 12:34:52.536883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 345/673] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:34:52.654483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.657020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.670096 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.675097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.676532 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.678238 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.679464 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.680285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.741048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:34:52.857496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-347f9b12-7872-4b58-9c9a-1536d5f99e0e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 204 len: 0 microversion: 2.1 time: 0.210926 Nov 02 12:34:52.865355 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 329/674] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:34:52 2022] DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:52.874359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.877054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:52.891670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.893166 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.894299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.896576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:52.897778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:52.899074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:52.997923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:52.999568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:53.011882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.011882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.011882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.011882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.012580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.012580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.081409 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.082597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.083458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.084303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'fault' on Instance uuid d421a0ad-d6ba-492d-9d77-90d12500d3e6 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:53.107737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.116079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-235c2afa-0b96-40ea-80f6-8cbedb8d1f1a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1674 microversion: 2.1 time: 0.249232 Nov 02 12:34:53.116844 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 346/675] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1674 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:53.125211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:53.126102 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:53.136556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.137303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.138175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.139142 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.141383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.142080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.143362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.160503 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ba0d7c9d-f544-4bc2-a011-1b945d6474b9 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1334 microversion: 2.1 time: 0.171237 Nov 02 12:34:53.161136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 330/676] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:52 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1334 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:53.306876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.318038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3527346f-f3a5-41f0-82d1-fa3c3371d7f1 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.197849 Nov 02 12:34:53.318962 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 347/677] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:53 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:53.449363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:53.449968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:53.456760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.457272 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.457730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.458578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:53.459881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:53.459881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:53.621952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.636227 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.639059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:53.641752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df5f7b2a-5226-4c64-8e10-86eb77772306 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.196069 Nov 02 12:34:53.642770 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 331/678] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:53 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:54.151128 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.152667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.167018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.167893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.168670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.170002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.170751 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.171978 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.185539 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.186568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.196866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.197894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.198625 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.199842 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.200732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.201476 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.250844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.251410 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.252005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.252597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'fault' on Instance uuid d421a0ad-d6ba-492d-9d77-90d12500d3e6 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:34:54.308248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.318246 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd72e2cc-bb37-43a7-a65d-b3b246c92ac5 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 200 len: 1334 microversion: 2.1 time: 0.136822 Nov 02 12:34:54.318874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 332/679] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:54.348304 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.349298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.356464 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.357087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.357639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.358552 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.359651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.359971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.360252 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.368909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5e12a27f-a1d0-4258-b42c-2d4a3a162bf4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1674 microversion: 2.1 time: 0.224198 Nov 02 12:34:54.369838 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 348/680] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1674 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:54.524060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.534270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-04743e22-4217-465e-940b-78935c766849 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.189788 Nov 02 12:34:54.534859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 333/681] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:54.683904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:54.684632 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:54.690976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.691467 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.691943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.692649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:54.693111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:54.693542 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:54.852608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.868947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.870402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:54.871583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-65a40f9d-a70b-4ac0-8fb4-e7c21d2897c9 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.191642 Nov 02 12:34:54.872146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 349/682] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:54 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:55.345537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.346932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d421a0ad-d6ba-492d-9d77-90d12500d3e6] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.357126 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.357894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.358349 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.359730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.360327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.360623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.376374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] HTTP exception thrown: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Request method failure captured: Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 HTTP/1.1 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKZnW8x3KSJFcsvcZjFTbd7Fbs_YppMYEpFh43nUxOdEojqzUzC551yaMAYnRscT9N5AXqoUygfBN3itwprc-l3gH6g-a-s1ILC4w9jlR7yatBHg-X7K5E8DAvMfhsu5CiRVxx_V6ylfFGdbPevnUFf1cT3KFx4670yeolY7Ri2ZyU Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:34:55.378141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 7c5ccd8c99934f60b4ca26c4990b7412 Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. Nov 02 12:34:55.380079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd421a0ad-d6ba-492d-9d77-90d12500d3e6'} Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:55.381167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. Nov 02 12:34:55.382577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:34:55.383859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Returning 404 to user: Instance d421a0ad-d6ba-492d-9d77-90d12500d3e6 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:55.383859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-25ee34bc-ef07-46cb-8afe-2bef21046bcc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6" status: 404 len: 111 microversion: 2.1 time: 0.038992 Nov 02 12:34:55.383859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 334/683] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/d421a0ad-d6ba-492d-9d77-90d12500d3e6 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:34:55.389211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-634d22ae-9bd3-4f2d-833b-1a67ee12b303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '.version_select at 0x7faf06968a60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.394072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.395321 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.410090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.410918 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.411626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.412960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.413735 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.414456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.420549 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-634d22ae-9bd3-4f2d-833b-1a67ee12b303 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-237641760" status: 202 len: 0 microversion: 2.1 time: 0.035132 Nov 02 12:34:55.421666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 350/684] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Nov 2 12:34:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-237641760 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:34:55.576255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.578013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.592299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.594535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.595215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.597827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.598644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.599358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.701536 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.719983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-57ee9a65-9ae8-400a-a3f0-0c4a71ec8ea7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1674 microversion: 2.1 time: 0.330349 Nov 02 12:34:55.733083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 335/685] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1674 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:55.847881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:55.857175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ee3039f6-7cf4-47ae-9cd6-fee4c84dc8d5 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.289247 Nov 02 12:34:55.857772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 351/686] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:55.898125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:55.898747 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:55.905730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.906221 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.906659 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:55.907551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:55.908005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:55.908421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.226907 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.233466 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:34:56.244957 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.247398 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.249080 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ed0c7fbd-963c-45c0-a97b-6662f6824c4c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.355194 Nov 02 12:34:56.250199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 336/687] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:55 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:34:56.749494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.750534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.760891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.761935 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.762794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.764062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.765373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.766099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.883881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:56.884773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:56.886852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:56.895125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.896208 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.896877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.898037 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:56.898687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:56.899337 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:56.901045 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ee8b5752-d67a-4a65-bc86-095ca36ea80e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 200 len: 1607 microversion: 2.1 time: 0.155731 Nov 02 12:34:56.901961 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 352/688] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 1607 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:57.120495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e473906-98d3-4493-8449-d57838bdae8f", "name": "network-vif-deleted", "tag": "c5761531-577c-4309-a7db-9bb6acfee9dc"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:57.137690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.140581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.140979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.168458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] Creating event network-vif-deleted:c5761531-577c-4309-a7db-9bb6acfee9dc for instance 4e473906-98d3-4493-8449-d57838bdae8f on hv-cinder-86327 Nov 02 12:34:57.176009 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.188953 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fb302b67-11e8-4cd3-85ce-2aac2b0edd46 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.309391 Nov 02 12:34:57.191116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 337/689] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:56 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:34:57.191741 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-acc7a5d2-79f8-4bb8-b562-b450f0311fa1 req-d8445ea0-3bde-466d-a25c-ea72e2ec20c5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078944 Nov 02 12:34:57.196450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 353/690] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:34:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:57.279700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.281359 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.289672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.290161 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.290797 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.292118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.292233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.292594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.473875 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.485269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.487100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:57.489055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e1486221-4f87-4e08-be42-5406a7c4d9f7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.217269 Nov 02 12:34:57.489920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 338/691] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:57.929850 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.930538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:57.939194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.939696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.940197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.940917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:57.941406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:57.941830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:57.957110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f HTTP/1.1 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:34:57.958793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:34:57.960345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '4e473906-98d3-4493-8449-d57838bdae8f'} Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:34:57.961215 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:34:57.962427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:34:57.963572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:34:57.963572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e96b6ada-34fb-4e31-9808-85f081c72564 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 404 len: 111 microversion: 2.1 time: 0.035669 Nov 02 12:34:57.963572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 354/692] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:57 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:34:57.970321 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-30c0f7e5-53fd-4c59-994d-b573ad065def tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '.version_select at 0x7faf06925700>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:57.994175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-30c0f7e5-53fd-4c59-994d-b573ad065def tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022384076" status: 202 len: 0 microversion: 2.1 time: 0.025732 Nov 02 12:34:57.995624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 339/693] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Nov 2 12:34:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2022384076 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:34:58.236928 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.238277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.267293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.268525 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.269907 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.270836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.271539 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.272058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.520078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:58.521232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:58.545699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.549500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.550303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.552914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:58.553826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:58.554571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:58.740648 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.752429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-46322f02-cb8c-4721-9594-22c035a42e74 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.523788 Nov 02 12:34:58.753440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 355/694] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:58.846307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.856077 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.857739 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:58.859590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-51cdc603-94ab-4c5c-8f13-de96772e2ed7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.347612 Nov 02 12:34:58.860721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 340/695] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:58 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:34:59.132240 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-20505c4a-33ab-4ba3-adab-0c60d5e198fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: .version_select at 0x7faf06955b80>, body: {"keypair": {"name": "tempest-keypair-646614174", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrzv4c6WKlxiwAeowjhncM3O8oS2lFF0npjZl6pSUNQcwZlmnGk05pjKsrGddwOKMQzLy/E2AXY/3NDHLlS4MY//VVHzQZdMLLzvKRrCGKDTuBOIRdjPHrwarjzAEfZrw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:34:59.151948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-20505c4a-33ab-4ba3-adab-0c60d5e198fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:34:59.159060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-20505c4a-33ab-4ba3-adab-0c60d5e198fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for user aacb777ebdf445eca64d1e46c2bdeced and project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:34:59.186841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-20505c4a-33ab-4ba3-adab-0c60d5e198fa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060173 Nov 02 12:34:59.187636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 356/696] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:34:59 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:34:59.610476 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.611083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.617962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.618449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.619092 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.619795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.620567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.621190 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.651963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:34:59.736627 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eac12541-cd5f-4f41-ab77-4438c09c7204 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 204 len: 0 microversion: 2.1 time: 0.130456 Nov 02 12:34:59.737282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 341/697] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:34:59 2022] DELETE /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:34:59.745272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.745879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.752529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.753018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.753481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.754221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.754668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.755092 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.779151 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.780055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.787229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.787938 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.788520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.789557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.790010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.790429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.898389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:34:59.906785 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7cf821c5-995c-4d52-b7af-794ca9678e6d tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1507 microversion: 2.1 time: 0.165300 Nov 02 12:34:59.907730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 357/698] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:34:59.928894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:34:59.929543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:34:59.937616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.938103 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.938536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:34:59.939234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:34:59.939687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:34:59.940110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.030149 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.040313 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2cbead71-f0e8-4792-b0c5-84f08a4a8526 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.265365 Nov 02 12:35:00.041192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 342/699] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:00.076285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.084541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.086228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:00.087414 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6d605340-7a71-4de1-9a7b-fad93d2c171a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.178414 Nov 02 12:35:00.088056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 358/700] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:34:59 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:00.715935 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1078134673", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a1cd3d90-2bea-43ce-84ec-dc31298b79c7"}], "security_groups": [{"name": "tempest-securitygroup--888423790"}], "key_name": "tempest-keypair-646614174", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:00.822148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] validate_networks() for [('a1cd3d90-2bea-43ce-84ec-dc31298b79c7', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:00.934618 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:00.935325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:00.943828 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.944376 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.944873 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:00.945706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:00.946244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:00.946728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.086993 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.097945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-13db161a-d840-46a3-b955-076538c2e339 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1507 microversion: 2.1 time: 0.167353 Nov 02 12:35:01.098628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 359/701] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:00 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1507 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:01.112777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.113616 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.119874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.120355 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.120790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.121528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.121985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.122409 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.254568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.255534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:01.255949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:01.256446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:01.256872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:01.257307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:01.262685 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-87307ff4-3796-4d8b-97ea-4df27072b353 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.154160 Nov 02 12:35:01.263251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 360/702] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:01.268086 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.268757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.275865 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.276433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.276813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.276948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.277335 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.277718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.277840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.278176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.278469 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:01.278581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.278917 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:01.279333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:01.297596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:01.301562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Getting quotas for user aacb777ebdf445eca64d1e46c2bdeced and project 5bc73b74407f4d6184cbd1330ee89145. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:01.303973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:01.314846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:01.317160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:01.366169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-140db80c-1617-4258-9655-fa611ebaf523 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.654458 Nov 02 12:35:01.366817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 343/703] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:01.378172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b84cbca0-a001-445b-ba7c-04bf9b38868f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:01.378868 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b84cbca0-a001-445b-ba7c-04bf9b38868f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:01.425926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.435230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.436727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.437663 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b84cbca0-a001-445b-ba7c-04bf9b38868f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:01.438161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-44481f32-ad2f-4cfc-ae1c-412b15b9a561 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.173606 Nov 02 12:35:01.438731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 361/704] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:01.445500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b84cbca0-a001-445b-ba7c-04bf9b38868f tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1237 microversion: 2.1 time: 0.071436 Nov 02 12:35:01.446252 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 344/705] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:01 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:02.121852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.122466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.131244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.131716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.132348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.133085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.133703 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.134123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.278620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.287370 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.287887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bd93d044-f46b-400b-a2d4-c3bf4bbf76bb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1507 microversion: 2.1 time: 0.169809 Nov 02 12:35:02.288041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.288781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 362/706] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1507 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:02.300317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.300853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.301456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.302188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.302641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.305580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.449507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d700e60e-c573-4867-af81-4967f45d07ff", "name": "network-vif-deleted", "tag": "c0732d77-2305-43de-9231-76f0cfe969f9"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:02.460911 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.461661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.462418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.481720 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] Creating event network-vif-deleted:c0732d77-2305-43de-9231-76f0cfe969f9 for instance d700e60e-c573-4867-af81-4967f45d07ff on hv-cinder-86327 Nov 02 12:35:02.488506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e37225b7-10b3-4c44-9ccf-7c71e1789b87 req-bcd13fd8-9082-4826-a1cc-8d71424d24db service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042415 Nov 02 12:35:02.489810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 363/707] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:02.500569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.502845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.515630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.516491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.517553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.519086 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.519945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.520726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.525153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.534467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5ab87034-5f34-4f5c-a43a-9eac870e8009 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.252181 Nov 02 12:35:02.549096 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 345/708] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:02.556977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:02.557778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:02.564009 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.564489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.564914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.565944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:02.566368 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:02.566958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:02.647964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.657593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0be2a4ce-ce2c-4fc4-b093-42046de31aaa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1289 microversion: 2.1 time: 0.106989 Nov 02 12:35:02.658737 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 346/709] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1289 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:02.761418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.777748 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.779198 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:02.781066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3c851c41-299c-4838-b162-c55310038ca4 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1743 microversion: 2.20 time: 0.288675 Nov 02 12:35:02.797043 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 364/710] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:02 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1743 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:03.310699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.311274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.319347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.319853 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.320293 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.321016 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.321486 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.321916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.359924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.360577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.361129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.361648 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'fault' on Instance uuid d700e60e-c573-4867-af81-4967f45d07ff {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:03.413401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:03.426985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d09b11d8-ac7b-4af6-954b-a7e1b9627868 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 200 len: 1311 microversion: 2.1 time: 0.120158 Nov 02 12:35:03.428059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 347/711] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 1311 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:03.559237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.559819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.562555 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:03.567883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.568481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.568913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.569635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.570084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.570501 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.576001 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:03.692448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.693138 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.706386 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.706877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.707383 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.708167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.708791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.709473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.744328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:03.756446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-72b00d5a-63ad-48e7-9617-6c7ba5fcf762 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.201406 Nov 02 12:35:03.757202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 365/712] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:03.814978 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:03.815833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:03.823353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.823851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.824287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.825240 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:03.825594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:03.826035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:03.948000 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:03.965718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ea5d6036-6d11-4db1-9747-83b9aa457cb2 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.277109 Nov 02 12:35:03.967071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 348/713] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:04.006459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.015660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.017300 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.018452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3770884a-e73d-4cac-b79c-5156c82d5976 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1743 microversion: 2.20 time: 0.208880 Nov 02 12:35:04.019008 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 366/714] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:03 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1743 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:04.456144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.457563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: d700e60e-c573-4867-af81-4967f45d07ff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.464158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.473167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.473904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.474965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.475730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.476314 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.493543 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] HTTP exception thrown: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Request method failure captured: Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff HTTP/1.1 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKZnW8x3KSJFcsvcZjFTbd7Fbs_YppMYEpFh43nUxOdEojqzUzC551yaMAYnRscT9N5AXqoUygfBN3itwprc-l3gH6g-a-s1ILC4w9jlR7yatBHg-X7K5E8DAvMfhsu5CiRVxx_V6ylfFGdbPevnUFf1cT3KFx4670yeolY7Ri2ZyU Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:35:04.495748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 7c5ccd8c99934f60b4ca26c4990b7412 Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. Nov 02 12:35:04.497173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'd700e60e-c573-4867-af81-4967f45d07ff'} Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:04.497929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. Nov 02 12:35:04.499923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:04.502630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Returning 404 to user: Instance d700e60e-c573-4867-af81-4967f45d07ff could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:04.502630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-249712db-1529-471f-b7ba-1c792090997e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff" status: 404 len: 111 microversion: 2.1 time: 0.046071 Nov 02 12:35:04.502630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 349/715] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/d700e60e-c573-4867-af81-4967f45d07ff => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:04.507218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.509076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.517425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.517925 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.518375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.519284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.519758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.520190 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.554252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:35:04.596607 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f017e017-63a6-4bf5-9a99-ed0c3ac5cd59", "tag": "6e038057-aa49-4208-9894-13991bb26bf9"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:04.620202 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.621203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.622561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.645483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] Creating event network-changed:6e038057-aa49-4208-9894-13991bb26bf9 for instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 on hv-cinder-86327 Nov 02 12:35:04.652224 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-920aff83-bb63-4c28-bdfd-55dba796c18a req-d611f809-7ef3-4ed0-bcb3-0c05a323339f service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061271 Nov 02 12:35:04.653545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 350/716] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:04.678326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5b705347-340f-4262-a47b-838879b6bfdc tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "DELETE /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 204 len: 0 microversion: 2.1 time: 0.174505 Nov 02 12:35:04.679187 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 367/717] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:35:04 2022] DELETE /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:04.690700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.691882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.699269 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.700647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.701442 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.703111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.703776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.704493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.823731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:04.836763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.837472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.838137 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.852522 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] Creating event network-vif-plugged:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:35:04.860289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-90dba544-6a03-41f3-8604-ae8338b30289 req-b6e96b76-8e8a-45be-9092-021bbb150b8b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111131 Nov 02 12:35:04.861394 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 368/718] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:04.867866 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.868775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.870138 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:04.876770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.877878 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.878732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.879600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.879884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7ad355d2-17cc-4729-b1a3-45b6b132dac2 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.195539 Nov 02 12:35:04.880209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:04.880819 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 351/719] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:04.880943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:04.991291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:04.991906 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:04.998360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:04.998838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.000520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.001268 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.001727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.002148 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.038362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.047184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-39055646-dfba-4585-b534-898acf9dc895 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.184235 Nov 02 12:35:05.047894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 369/720] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:05.054074 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.055064 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.062500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.063131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.063634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.064419 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.064946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.065835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.158700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.166959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f2407e1-3b2f-43f9-a442-a07fc0cf9be7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.179548 Nov 02 12:35:05.167844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 352/721] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:04 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:05.234533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.243164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.244829 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:05.246145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9406ed73-9ff4-419c-8270-0aa9a2dd20fc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.197215 Nov 02 12:35:05.246712 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 370/722] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:05.903382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:05.903967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:05.911069 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.911542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.911969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:05.912657 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:05.913136 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:05.913553 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.058647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.067511 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e62e5575-626e-4f04-8be7-89031512644f tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.167973 Nov 02 12:35:06.068097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 353/723] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:05 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.077775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.078574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.085266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.085768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.086200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.086914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.087370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.087795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.194701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.195608 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.202884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.203370 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.203802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.204506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.204950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.205394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.231498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.239822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-48bd2697-35a3-4dd5-a8a0-1626067c49cd tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.165907 Nov 02 12:35:06.240442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 371/724] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:06.273609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:06.274182 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:06.280945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.281470 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.281900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.282614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.283070 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.283635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.346140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.354384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39fd165f-8d9a-4ad4-aa6e-87e3cd900416 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.164220 Nov 02 12:35:06.355081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 354/725] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:06.428360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.437825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.439283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:06.440452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e995f709-7592-4988-9502-2c373d848b28 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.170932 Nov 02 12:35:06.449231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 372/726] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:06 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:06.887576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "name": "network-vif-plugged", "status": "completed", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:06.924722 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:06.925480 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:06.925688 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:06.959381 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] Creating event network-vif-plugged:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:35:06.965044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-4a70aa12-505e-447b-887f-41070ab026d3 req-5fcd470e-3c78-48fd-ad20-f01874f4d96c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082628 Nov 02 12:35:06.966062 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 355/727] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:07.094691 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.095631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.112486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.114893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.118129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.119266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.120075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.120977 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.266396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.267607 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.281501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.285379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.286521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.287866 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.289670 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.292147 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.342925 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:07.425668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.439311 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a08abf9b-8a65-4c34-88e9-760d0ad0d01e tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1520 microversion: 2.1 time: 0.350805 Nov 02 12:35:07.442259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 373/728] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.449998 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.450840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.465853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.466609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.467317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.468731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.469381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.469965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.742118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.751425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:07.751609 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-58ef60c0-bbe8-48cc-ba70-c38e32222e13 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.491496 Nov 02 12:35:07.758054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 356/729] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.763040 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:07.763550 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-02631db6-cf4a-4573-8f69-9bd688f88020 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.319461 Nov 02 12:35:07.763678 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:07.773962 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 374/730] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:07.794861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.795357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.800419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:07.801256 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:07.801730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:07.802965 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.124267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3fc268ed-bf55-4bb7-a64b-66e569798119", "name": "network-vif-deleted", "tag": "1ca93775-d02f-4a64-aedd-28dd21814b95"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:08.143326 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.144135 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.144874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.176737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] Creating event network-vif-deleted:1ca93775-d02f-4a64-aedd-28dd21814b95 for instance 3fc268ed-bf55-4bb7-a64b-66e569798119 on hv-cinder-86327 Nov 02 12:35:08.198657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-75bd3a8d-3a06-4307-997e-53f92a849154 req-11ba69a8-f22a-47c4-9cb2-4c36ff32737b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078405 Nov 02 12:35:08.200602 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 375/731] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:08.356131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.371975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.374930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.380036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5c8003bb-f77d-4a7e-8ecc-7e8c54e48c56 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.620657 Nov 02 12:35:08.383884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 357/732] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:07 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:08.468415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.469406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.482705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.482705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.482705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.482705 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.483629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.483629 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.521275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.521789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.522420 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.523127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'fault' on Instance uuid 3fc268ed-bf55-4bb7-a64b-66e569798119 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:08.575149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:08.587955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-fea9afd1-6fac-4f81-b0a0-a08d89981125 tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1311 microversion: 2.1 time: 0.123891 Nov 02 12:35:08.589990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 376/733] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1311 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:08.782416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.789489 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.793831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:08.795191 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:08.809318 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.810747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.812026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.812819 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.813158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.815126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.815754 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.816305 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:08.817098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.817756 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:08.820363 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:08.825390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.083299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.095604 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-57c33382-6597-4b0d-8906-dae1a19f5f7a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.308445 Nov 02 12:35:09.097222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 377/734] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:09.161932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.173598 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ad10753f-6294-4126-acb3-764e53d807f7 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1576 microversion: 2.1 time: 0.398942 Nov 02 12:35:09.174500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 358/735] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:08 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1576 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:09.408813 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.410513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.421465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:09.434570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.435453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.437085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.438097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.439303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.439963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.612417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:09.613293 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:09.619982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.620471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.621718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.622666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.623345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.623974 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.649879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.664232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:09.665038 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:09.665650 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:09.666276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lazy-loading 'fault' on Instance uuid 3fc268ed-bf55-4bb7-a64b-66e569798119 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:35:09.692119 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.703937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.709392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0dd18b6e-5834-4ee0-85b0-59d614dfd10a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.302282 Nov 02 12:35:09.715144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 378/736] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:09.840038 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ccd8c99934f60b4ca26c4990b7412', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dfb62f918dd41aea2e6d49286476dd0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:09.858288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd1a0efe-b242-44ef-8a15-becf56dfcccd tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 200 len: 1311 microversion: 2.1 time: 0.250387 Nov 02 12:35:09.859595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 359/737] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:09 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 1311 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:10.143700 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.144628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.151436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.152235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.152694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.153421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.153874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.154311 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.199658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.200641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.222797 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.223307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.234802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.235779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.236372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.236911 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.389431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.421958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b5b7b0dc-9b78-46f0-bc43-9dcf03cb34f4 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.282043 Nov 02 12:35:10.425076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 379/738] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:10.520165 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:10.529694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1c0e825d-ee00-42e6-82ba-472d7b3bdf2f tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1563 microversion: 2.1 time: 0.334759 Nov 02 12:35:10.541030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 360/739] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1563 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:10.752907 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.757280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.765790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.767663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.773149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.774353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.775114 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.775808 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.886012 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:10.887331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] [instance: 3fc268ed-bf55-4bb7-a64b-66e569798119] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:10.899446 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.900578 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.901869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.904550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:10.905805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:10.906701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:10.933890 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] HTTP exception thrown: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Request method failure captured: Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 HTTP/1.1 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKZnW8x3KSJFcsvcZjFTbd7Fbs_YppMYEpFh43nUxOdEojqzUzC551yaMAYnRscT9N5AXqoUygfBN3itwprc-l3gH6g-a-s1ILC4w9jlR7yatBHg-X7K5E8DAvMfhsu5CiRVxx_V6ylfFGdbPevnUFf1cT3KFx4670yeolY7Ri2ZyU Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:35:10.938039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3dfb62f918dd41aea2e6d49286476dd0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3dfb62f918dd41aea2e6d49286476dd0 Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1465642271 Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 7c5ccd8c99934f60b4ca26c4990b7412 Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1465642271-project Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. Nov 02 12:35:10.940545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '3fc268ed-bf55-4bb7-a64b-66e569798119'} Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:35:10.943094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. Nov 02 12:35:10.947873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:35:10.952279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] Returning 404 to user: Instance 3fc268ed-bf55-4bb7-a64b-66e569798119 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:35:10.952279 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-80b7ac66-d606-483e-a456-01102eaf65cb tempest-ServerRescueNegativeTestJSON-1465642271 tempest-ServerRescueNegativeTestJSON-1465642271-project] 10.222.0.85 "GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119" status: 404 len: 111 microversion: 2.1 time: 0.063877 Nov 02 12:35:10.953018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 361/740] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/3fc268ed-bf55-4bb7-a64b-66e569798119 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:35:11.041830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.060919 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.063524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.065908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-213c6bba-a8da-483f-969c-aa56c857d729 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.323766 Nov 02 12:35:11.066849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 380/741] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:10 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:11.482574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:11.483822 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:11.487088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:11.491045 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=8 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:11.500497 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.501433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.502248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.503205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:11.504114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:11.507622 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:11.804203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:11.826115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-64a81488-50c2-4ba9-979c-547438a5586c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.347630 Nov 02 12:35:11.829854 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 362/742] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:11 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:12.104920 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.106460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.114812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.115584 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.116227 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.117203 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.117816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.118388 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.124823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:12.296450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.309345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.311650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:12.313211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-60f2d5d0-59f4-44da-91a5-589f6f4b25d0 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.214512 Nov 02 12:35:12.320938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 381/743] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:12.626878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f017e017-63a6-4bf5-9a99-ed0c3ac5cd59", "name": "network-vif-plugged", "status": "completed", "tag": "6e038057-aa49-4208-9894-13991bb26bf9"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:12.661481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.662496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.666015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.706510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] Creating event network-vif-plugged:6e038057-aa49-4208-9894-13991bb26bf9 for instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 on hv-cinder-86327 Nov 02 12:35:12.715114 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c55f2fee-7bbe-460d-aae6-7f7328cf59ee req-059e7482-70fd-4fd9-a7ee-8d40e82c57d0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094162 Nov 02 12:35:12.720192 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 363/744] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:12.858016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:12.863444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:12.877090 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.877598 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.878021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:12.879365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:12.879365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:12.879595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.077669 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.087265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-011dfcb3-7d77-4575-87c7-6faaaba3e3a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.237291 Nov 02 12:35:13.091914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 382/745] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:12 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:13.343196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:13.344263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:13.358837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.359484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.361691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.362562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:13.365793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:13.366346 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:13.857357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.879479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.881778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:13.883937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cd5e544c-4ac2-4280-8336-6db2f7295afd tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.546432 Nov 02 12:35:13.907179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 364/746] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:13 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:14.115417 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.116496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.128687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.129726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.130468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.131699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.132853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.133940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.354929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:14.388067 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5378a778-aef0-47a4-9663-4d3366d608a0 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1362 microversion: 2.1 time: 0.279601 Nov 02 12:35:14.406342 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 383/747] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1362 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:14.919672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:14.922486 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:14.936264 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.936978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.937785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:14.942435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:14.943542 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:14.943994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.301597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.315223 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.323060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.325918 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f1cab614-4991-425b-adc1-2c09ecf74707 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.414204 Nov 02 12:35:15.358052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 365/748] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:14 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:15.418755 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.429576 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.438489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.439423 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.440134 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.441248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.442011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.442693 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.708240 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:15.719794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b43e4922-d8f4-41a2-a379-aafb4308e275 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1549 microversion: 2.1 time: 0.308798 Nov 02 12:35:15.720434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 384/749] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1549 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:15.749893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:15.750423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:15.761891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.762378 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.765551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.766531 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:15.767171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:15.767778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:15.871470 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e4895ac1-88dd-4ae4-a1d5-d4a0e2625bfa tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.127583 Nov 02 12:35:15.872065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 366/750] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:35:15 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-interface => generated 285 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:16.380175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:16.380791 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:16.387204 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.387696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.389607 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.393164 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:16.393652 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:16.394094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:16.644600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.678366 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.682715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:16.685233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-24696a50-5a05-43a2-969e-4fb39d6c0741 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.308662 Nov 02 12:35:16.686957 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 385/751] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:16 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:17.507892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f017e017-63a6-4bf5-9a99-ed0c3ac5cd59", "tag": "6e038057-aa49-4208-9894-13991bb26bf9"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:17.519813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.521775 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.522494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.537550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] Creating event network-changed:6e038057-aa49-4208-9894-13991bb26bf9 for instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 on hv-cinder-86327 Nov 02 12:35:17.544102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-0d989b3a-edff-4edb-8e3b-ade251e6fe0c req-024d92d5-1631-40df-8bfb-ae0bb036cce5 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040166 Nov 02 12:35:17.553775 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 367/752] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:17.716802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:17.717840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:17.734023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.734783 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.735408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.737131 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:17.737934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:17.738543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:17.945451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.956593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.958458 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:17.959913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-efa9ffc8-c291-4542-87a4-ea1d16835627 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.249390 Nov 02 12:35:17.961143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 386/753] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:17 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:18.994696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:18.995877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:19.034963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.036342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.037201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.044039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:19.045572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:19.046785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:19.432152 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.456467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.461687 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:19.464390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ef3f3249-b16a-4038-b8c3-4dea9e91d70a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1738 microversion: 2.20 time: 0.479292 Nov 02 12:35:19.492196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 368/754] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:18 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1738 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:20.529357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:20.531742 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:20.541390 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.542511 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.543252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.544251 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:20.545060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:20.545843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:20.814353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.828396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.831715 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:20.834440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-89aa87da-abe1-455c-abee-4e69d1cd1212 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1720 microversion: 2.20 time: 0.312776 Nov 02 12:35:20.835221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 387/755] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:20 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1720 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:21.880978 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:21.881931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:21.892522 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.893651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.894411 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:21.895656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:21.896324 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:21.896877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:22.048420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.057470 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.059047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:22.060457 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-18cca9ca-7925-43b0-9ea9-83b35fff5fea tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1720 microversion: 2.20 time: 0.186199 Nov 02 12:35:22.061047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 369/756] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:21 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1720 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:23.129881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:23.132175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.144777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.145886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.147768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.149956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.151011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.152529 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.460443 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.482963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.484428 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:23.485795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8fc3017c-a895-4181-9277-441a82f20630 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1663 microversion: 2.20 time: 0.383109 Nov 02 12:35:23.486370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 388/757] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:23 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1663 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:23.518363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dd41ad44-b0a1-411f-8072-b301b2a959b7"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:23.522299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:23.531762 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.532257 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.532693 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.533451 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:23.533897 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:23.534323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:23.995254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8957ec0c-b7bd-4c14-abcd-ef62399ce193 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: .version_select at 0x7faf068d6e50>, body: {"keypair": {"name": "tempest-keypair-1336369031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIG25yoJlMbBdUAt3cjYZSH83xeyF4I7hZL3aaqXvmm2zEx77qIkl7avXlLOsYs9gIybyD+cp9ZxllxhlHwd8UQ92zMKYhFHNbm0ET/elNJKZwJvG2xGc4lzHgCCcqq/kw=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:24.015774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-8957ec0c-b7bd-4c14-abcd-ef62399ce193 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:24.021169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-8957ec0c-b7bd-4c14-abcd-ef62399ce193 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:24.047586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4564e50e-6e82-4c1a-9bd1-cb61aa37f205 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.537795 Nov 02 12:35:24.048272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8957ec0c-b7bd-4c14-abcd-ef62399ce193 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.231386 Nov 02 12:35:24.048666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 370/758] 10.222.0.85 () {62 vars in 1364 bytes} [Wed Nov 2 12:35:23 2022] POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments => generated 188 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Nov 02 12:35:24.050010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 389/759] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:35:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:35:24.229878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.230396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.237674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.238441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.238882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.240710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.240710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.241207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.396235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:24.562085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "name": "network-vif-unplugged", "status": "completed", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:24.587252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.587884 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.588321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.615341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.compute.server_external_events [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] Unable to find a host for instance f036557f-8699-4d06-ad2e-8c113952f2c4. Dropping event network-vif-unplugged {{(pid=120739) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Nov 02 12:35:24.620981 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-e6659a8a-8b1d-4cc1-9b2d-678f7f62e494 req-c054a71e-f020-4a2b-afbe-042d0ac4d2ba service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.063577 Nov 02 12:35:24.623758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 390/760] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 67 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Nov 02 12:35:24.639282 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bd9b0818-acfb-4b3b-bb1b-2337c4ab9df7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments/dd41ad44-b0a1-411f-8072-b301b2a959b7" status: 202 len: 0 microversion: 2.20 time: 0.414833 Nov 02 12:35:24.640216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 371/761] 10.222.0.85 () {60 vars in 1457 bytes} [Wed Nov 2 12:35:24 2022] DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments/dd41ad44-b0a1-411f-8072-b301b2a959b7 => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:24.737567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:24.738626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.747494 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.748259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.748982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.750903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.751221 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.752263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.801488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120739) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Nov 02 12:35:24.920793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9b27ef07-691c-4e65-8038-e5e2c5899e59 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/action" status: 202 len: 0 microversion: 2.20 time: 0.192722 Nov 02 12:35:24.922236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 391/762] 10.222.0.85 () {62 vars in 1319 bytes} [Wed Nov 2 12:35:24 2022] POST /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:35:24.935999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:24.937519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:24.949412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.950437 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.953571 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:24.955337 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:24.956377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:24.957151 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:25.191950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.202050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.203576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:25.204838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-296df81d-2c9a-48a5-8243-26f3ec1340a2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1671 microversion: 2.20 time: 0.275912 Nov 02 12:35:25.205463 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 372/763] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:24 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1671 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:26.193702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-669801463", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "131d0da7-02ff-497d-ba38-17a9c0dcd040"}], "security_groups": [{"name": "tempest-securitygroup--2105469599"}], "key_name": "tempest-keypair-1336369031", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:26.232340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.233611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:26.250249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.250738 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.251178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.252006 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.252619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.253288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.328804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] validate_networks() for [('131d0da7-02ff-497d-ba38-17a9c0dcd040', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:35:26.448505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.462389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.464145 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:26.470998 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-df9e0b9e-40a6-4b3d-980d-7fb3ce961b5a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.243953 Nov 02 12:35:26.472291 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 373/764] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:26.801943 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:35:26.802347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:35:26.802825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:35:26.803275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:35:26.803800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:35:26.813093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.813583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.814050 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.814792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:26.815250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:26.815682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:26.835510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:35:26.842237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:35:26.854944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:35:26.858115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:35:26.918572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9d4db2ab-f8df-4eb9-b5ba-bd444cd1414c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729692 Nov 02 12:35:26.919234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 392/765] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:35:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:35:26.935382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0b81f09b-245c-4ac8-8fd1-ea2e404fd59d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:26.939322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0b81f09b-245c-4ac8-8fd1-ea2e404fd59d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.079216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-0b81f09b-245c-4ac8-8fd1-ea2e404fd59d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.093865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0b81f09b-245c-4ac8-8fd1-ea2e404fd59d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1241 microversion: 2.1 time: 0.165587 Nov 02 12:35:27.107362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 374/766] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:26 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1241 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:27.498814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:27.500393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:27.508446 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.509073 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.509732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.510548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:27.511307 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:27.511879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:27.703761 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.716533 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.718033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:27.719228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-09f66bc1-1635-4739-a418-ffd2390ba9ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.224955 Nov 02 12:35:27.720110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 393/767] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:27 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:28.118204 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.119676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.139098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.140249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.150921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.152146 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.152784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.154610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.247011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.255727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-08a29d34-d2a8-4916-adaf-eadf52bfc408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.142005 Nov 02 12:35:28.274202 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 375/768] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:28.748571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:28.749795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:28.756615 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.757129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.757568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.758498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:28.758949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:28.759358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:28.913143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.921947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.923502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:28.924768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1e617d7e-039b-4093-9d70-e278eae2b24a tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.181406 Nov 02 12:35:28.925488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 394/769] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:28 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:29.285887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.286616 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.293784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.297211 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.314504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.315977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.323986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.324951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.412255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:29.422134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9113500d-8bb6-4b1f-b53f-6e2e9a6a03e3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.140463 Nov 02 12:35:29.422847 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 376/770] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:29.954072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:29.954702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:29.958171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:29.962463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.962942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.963385 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:29.964105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:29.964628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:29.965116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.129994 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.138438 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.139955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.141233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-476717ed-ec1a-4a10-98dc-133dd9e1442c tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.191240 Nov 02 12:35:30.141793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 395/771] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:29 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:30.446264 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:30.447618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:30.455884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.456505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.457210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.458232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:30.458761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:30.459252 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:30.531236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:30.539555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d09784d9-88c7-4ec3-9e95-52af344ea65f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.097253 Nov 02 12:35:30.540230 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 377/772] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:30 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:31.167418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.168024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.175049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.175521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.175945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.176630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.177102 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.177521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.318964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.328241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.330153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.331804 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-88cce519-1eba-4e38-a44b-892d3aac4dcb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.168558 Nov 02 12:35:31.342082 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 396/773] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:31.562863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:31.563384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:31.566026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:31.583402 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.583897 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.584339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.585076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:31.585561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:31.585992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:31.655453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:31.663567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-023abfad-d948-4806-8079-abc4fc7c16a4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.104627 Nov 02 12:35:31.664208 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 378/774] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:31 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:32.358369 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.359845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.368911 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.375096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.375897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.376665 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.377168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.377795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.523099 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.531759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.533237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.534405 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a79d7fe-dee4-40eb-98ab-c4e5dae4d8ae tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.180732 Nov 02 12:35:32.534960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 397/775] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:32.689455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:32.690073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:32.697991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.698564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.698999 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.699746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:32.700219 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:32.701296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:32.774505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:32.783588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7ee5f46d-69c1-4d10-a1a8-729602140f64 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.098220 Nov 02 12:35:32.784368 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 379/776] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:32 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:33.562318 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.563029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.569879 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.570696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.571359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.572271 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.572934 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.573574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.715653 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.726348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.727774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.728933 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5bbb259-2db4-4d04-a496-6b5ed958f567 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.171108 Nov 02 12:35:33.729516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 398/777] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:33.806010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:33.806621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:33.813400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.813920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.814407 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.815140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:33.815610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:33.816035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:33.894891 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:33.904159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-52063fdf-716c-4eba-a53e-a436c943f115 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.101294 Nov 02 12:35:33.905284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 380/778] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:33 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:34.755812 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.756357 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.763444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.763938 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.764371 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.765384 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.765840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.766321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.771096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:34.928580 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:34.930121 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:34.939002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.940106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.940817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.943815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:34.944566 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:34.945385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:34.993597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.009655 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.010985 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.012636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c3941762-4e52-4b52-9387-72b9a1c45d06 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.261168 Nov 02 12:35:35.014192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 399/779] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:35.030425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:35.038721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8eb83685-cfdf-444e-8ccb-716348dd3b16 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.114785 Nov 02 12:35:35.039392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 381/780] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:34 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:36.039983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:36.040573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:36.048000 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.048498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.049146 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.050041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.050572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.051049 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.062100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:36.062767 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:36.069545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.070019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.070461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.071166 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:36.071619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:36.072048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:36.158199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.166098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c64a63e9-a849-47ac-9361-8aae6b85a0ef tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.107802 Nov 02 12:35:36.166968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 382/781] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:36 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:36.193093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.201986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.203427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:36.214451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5aa04cf9-806b-4bbc-8670-fe78aa0ec532 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.178264 Nov 02 12:35:36.215241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 400/782] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:36 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:37.189657 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.190248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.192531 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:37.197964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.198445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.198878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.199565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.200015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.200945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.239991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:37.240527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:37.242433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:37.243199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=10 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:37.249573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.250059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.250530 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.251192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:37.251645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:37.252066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:37.270046 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.277983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3a13a788-f27d-4d54-ad30-d6c52b8f68f6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.092131 Nov 02 12:35:37.278623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 383/783] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:37.385976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.394769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.396198 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:37.397397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-93b9efbe-8b81-4bb4-bd5d-3682a48a4068 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.161504 Nov 02 12:35:37.397960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 401/784] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:37 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:38.300677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.301433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.308509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.309107 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.309552 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.310751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.311203 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.311624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.374372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.381997 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3bbce9a6-b52d-419b-8fb9-b549cdb88bb6 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1293 microversion: 2.1 time: 0.085206 Nov 02 12:35:38.382564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 384/785] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1293 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:38.423093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:38.423692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:38.430109 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.430583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.431016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.431702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:38.432147 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:38.432566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:38.565781 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.573946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.575418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:38.576582 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0b56d346-b437-4de8-a920-704b30229b22 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.157924 Nov 02 12:35:38.577185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 402/786] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:38 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:39.406933 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.407607 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.413995 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.414475 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.414963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.415613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.416065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.416487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.602396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:39.603040 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:39.610197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.610704 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.611134 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.611833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:39.612278 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:39.612689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:39.712655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.723485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-62383d2f-1cda-49bf-b2dc-c4295d490414 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1299 microversion: 2.1 time: 0.320608 Nov 02 12:35:39.725133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 385/787] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1299 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:39.750573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.760461 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.762154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:39.764241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d98887bf-0647-4952-92a6-7ea18ee54ddb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.165822 Nov 02 12:35:39.764825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 403/788] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:39 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:40.604477 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2df250e-1726-4f54-a16d-759cf7372159", "tag": "37793e4a-f37f-4d9f-836a-8413dc503ee1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:40.620615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.621504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.622150 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.635235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] Creating event network-changed:37793e4a-f37f-4d9f-836a-8413dc503ee1 for instance f2df250e-1726-4f54-a16d-759cf7372159 on hv-cinder-86327 Nov 02 12:35:40.641365 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-374dc587-c8f8-4d3a-bfa8-670e85a98cfa req-19afd089-a5f8-46c9-802e-e5b098322bcc service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045706 Nov 02 12:35:40.641923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 386/789] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:40.750472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.751303 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.757622 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.758173 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.758671 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.759463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.759980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.760485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.791679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:40.792576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:40.799262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.799871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.800382 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.801200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:40.801835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:40.802263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:40.903208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:40.912768 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a131ea75-b4ac-424a-b76b-357c83957dbe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.166499 Nov 02 12:35:40.913674 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 404/790] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:35:41.033176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.041354 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.042784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:41.043945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-60ccb38a-3c8c-492c-a694-d3d807ec1feb tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.256528 Nov 02 12:35:41.044506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 387/791] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:40 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:41.936514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:41.937087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:41.943115 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.943593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.944021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:41.944731 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:41.945229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:41.945717 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.071351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:42.071992 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:42.074749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.080180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.080671 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.081130 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.082034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.082509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.083162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.083422 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c483caf9-e9b2-457c-928b-6fffbc24576b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.151510 Nov 02 12:35:42.085044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 405/792] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:41 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:42.088551 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:35:42.296266 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.304584 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.306055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:42.307232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-55b7dc47-7f1d-4ce1-a133-8690d4faa570 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.241298 Nov 02 12:35:42.307803 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 388/793] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:42 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:42.849484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "name": "network-vif-plugged", "status": "completed", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:42.858962 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:42.859433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:42.859894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:42.874252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] Creating event network-vif-plugged:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:35:42.880233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-526f7041-cc9b-479b-b222-a4b3082c8071 req-4b6f978a-fdeb-4382-8191-cea3188da393 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034375 Nov 02 12:35:42.881240 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 406/794] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:43.107825 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.108529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.115128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.115822 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.116254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.117296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.117751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.118334 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.254087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.261583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eebe045f-1d6a-4e5a-a2e6-4de1ff1d353a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.158383 Nov 02 12:35:43.262308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 389/795] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:43.334667 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:43.335344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:43.341872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.342348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.342778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.343453 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:43.343898 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:43.344312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:43.472208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.480573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.482061 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:43.483307 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1ae24249-ebe4-4ea7-ad2c-62da7ab90240 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.152943 Nov 02 12:35:43.483872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 407/796] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:43 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:44.285317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.285921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:44.292479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.292948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.293403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.294776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.295220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.295646 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.425246 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.432863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3ff2313b-9730-4044-a12b-224b2696ebde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.151419 Nov 02 12:35:44.433472 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 390/797] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:44.511772 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:44.512903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:44.519635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.520119 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.520558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.521292 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.521751 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.522172 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.660756 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.669096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.670543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:44.671775 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a0eeaf21-6ad5-4cbb-8067-29a6ab41c5b1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1729 microversion: 2.20 time: 0.164018 Nov 02 12:35:44.672585 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 408/798] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:44 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:35:44.907363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2df250e-1726-4f54-a16d-759cf7372159", "name": "network-vif-plugged", "status": "completed", "tag": "37793e4a-f37f-4d9f-836a-8413dc503ee1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:44.917464 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:44.917941 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:44.918396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:44.930137 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] Creating event network-vif-plugged:37793e4a-f37f-4d9f-836a-8413dc503ee1 for instance f2df250e-1726-4f54-a16d-759cf7372159 on hv-cinder-86327 Nov 02 12:35:44.935480 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c17fbfc7-7b8b-4390-b8b8-5be52fac9e27 req-c25d5afd-d538-417d-a4cb-d2a956e1f415 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032074 Nov 02 12:35:44.936170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 391/799] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:45.456502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:45.457178 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.463620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.464108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.464541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.465282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.465732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.466162 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.603094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.611021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6765c80c-f137-4187-8cae-364e50dc4d20 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.159189 Nov 02 12:35:45.611583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 409/800] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:45 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:45.699154 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:45.699901 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:45.706980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.707419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.707879 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.708609 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:45.709111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:45.709537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:45.842946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.851059 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.852520 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:45.853740 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7617cfa3-d4ef-421d-bb9b-af31e0492cbe tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1716 microversion: 2.20 time: 0.159428 Nov 02 12:35:45.854305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 392/801] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:35:45 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1716 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Nov 02 12:35:46.634304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:46.634916 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:46.642633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.643118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.643564 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.644248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:46.644696 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:46.645144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:46.781455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:46.789548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2ff07722-56fe-4b84-b4cb-2c7375401b18 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1367 microversion: 2.1 time: 0.158770 Nov 02 12:35:46.790511 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 410/802] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:46 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.815048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.815587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.821976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.822456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.822887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.823575 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.824050 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.824470 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.954413 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:35:47.962032 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-eaef54b9-6780-44e5-8758-b42fd694a9f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1556 microversion: 2.1 time: 0.151433 Nov 02 12:35:47.962587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 393/803] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1556 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:35:47.983901 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:47.984411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:47.990844 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.991316 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.991777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:47.992450 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:47.992893 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:47.993334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:48.068911 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e04e3c94-8e5c-452c-8412-fd63c29736fd tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088787 Nov 02 12:35:48.069571 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 411/804] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:35:47 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:49.053916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2df250e-1726-4f54-a16d-759cf7372159", "tag": "37793e4a-f37f-4d9f-836a-8413dc503ee1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:49.063393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:49.063870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:49.064294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:49.075857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] Creating event network-changed:37793e4a-f37f-4d9f-836a-8413dc503ee1 for instance f2df250e-1726-4f54-a16d-759cf7372159 on hv-cinder-86327 Nov 02 12:35:49.081373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-182c245a-6530-42e2-8551-7df44cfca829 req-6fdb7d93-937e-44af-8f57-b7625c76aa1d service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091202 Nov 02 12:35:49.082023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 394/805] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:35:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:54.428680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:35:54.429283 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:54.435525 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.436001 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.436432 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.437148 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:54.437603 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:54.438024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:54.461803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a97fee51-5c84-40f8-8d79-3c9df8c80f31 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/ips" status: 200 len: 146 microversion: 2.1 time: 0.139108 Nov 02 12:35:54.462358 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 412/806] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:35:54 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/ips => generated 146 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:35:55.801616 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f2769e4-55c2-46c8-8c4f-27d6cd7e9382"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:35:55.804019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:35:55.810844 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:55.811372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:55.811803 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:55.812493 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:35:55.812942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:35:55.813389 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:35:56.059717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4087c76d-09b9-4057-9166-1cebef1ffe94 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262885 Nov 02 12:35:56.060427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 395/807] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:35:55 2022] POST /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:03.649474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:03.651754 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:03.654505 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=35 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:03.660502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.660502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.660948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.661594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.662044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.662497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.695415 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5ba87a33-36e0-4125-a42e-cc980e4dd172 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049977 Nov 02 12:36:03.695990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 413/808] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:03 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:03.708157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:03.708734 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:03.711263 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=36 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:03.716884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.717395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.717827 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.718534 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:03.718985 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:03.719407 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:03.750709 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b39f671b-af44-4411-be1b-970f02fe3a98 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382" status: 200 len: 194 microversion: 2.1 time: 0.046820 Nov 02 12:36:03.751242 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 396/809] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Nov 2 12:36:03 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:05.114496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9333bb3b-18f3-445e-995c-f1e6485419e2"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:05.116888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:05.124592 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.125143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.125639 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.126396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:05.126858 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:05.127284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:05.129918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=81 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:05.405442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0685d118-9277-481c-964c-2064e88c1088 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "POST /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294739 Nov 02 12:36:05.408830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 414/810] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:36:05 2022] POST /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:12.969385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:12.971619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:12.978741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.979227 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.979664 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.980398 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:12.980852 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:12.981319 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:12.983937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:13.018121 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-50a399c6-4f12-4606-8012-2a3ffef74579 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.052574 Nov 02 12:36:13.018699 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 397/811] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:12 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 371 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:13.161652 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:13.162209 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:13.169105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.169591 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.170031 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.170729 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.171184 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.171608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.201762 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bb5c3afa-01be-4266-90f5-a15d5c44e53c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382" status: 200 len: 194 microversion: 2.1 time: 0.045252 Nov 02 12:36:13.202359 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 415/812] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Nov 2 12:36:13 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:13.212895 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:13.213406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:13.219422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.219904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.220334 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.221182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:13.221503 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:13.221922 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:13.306980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lazy-loading 'services' on Instance uuid f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:13.385991 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d313ee24-4059-4899-af96-c68d84fec39e tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382" status: 202 len: 0 microversion: 2.1 time: 0.176859 Nov 02 12:36:13.386651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 398/813] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:36:13 2022] DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/4f2769e4-55c2-46c8-8c4f-27d6cd7e9382 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:14.560989 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.561680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:14.568382 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.568863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.569333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.570060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.570516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.570941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.604263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e5951435-decb-48eb-909f-b97eaee9817c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/9333bb3b-18f3-445e-995c-f1e6485419e2" status: 200 len: 194 microversion: 2.1 time: 0.047718 Nov 02 12:36:14.604887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 416/814] 10.222.0.85 () {58 vars in 1413 bytes} [Wed Nov 2 12:36:14 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/9333bb3b-18f3-445e-995c-f1e6485419e2 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:14.617298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:14.617962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:14.625541 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.626026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.626458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.627166 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:14.627611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:14.628030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:14.723680 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lazy-loading 'services' on Instance uuid f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:14.799132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7766b195-d204-47e4-8a9f-a9cef0736867 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/9333bb3b-18f3-445e-995c-f1e6485419e2" status: 202 len: 0 microversion: 2.1 time: 0.186812 Nov 02 12:36:14.799758 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 399/815] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:36:14 2022] DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments/9333bb3b-18f3-445e-995c-f1e6485419e2 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:36:15.980516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:15.983379 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:15.990027 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.990504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.990936 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:15.991624 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:15.992111 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:15.992528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.020966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8f07df8d-d996-49d1-8d0c-9201c37c5131 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044683 Nov 02 12:36:16.021551 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 417/816] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:15 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:16.138545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.140682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.146914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.147396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.147832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.148530 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.148981 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.149426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.178754 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a9007f64-9776-4d0d-8a5b-65d9da9fb597 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045081 Nov 02 12:36:16.179309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 400/817] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:36:16.242601 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.243097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.249421 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.249904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.250341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.251035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.251486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.251908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.276298 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:16.351478 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2e146d81-6772-413a-bbab-987a4fb4e67a tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 204 len: 0 microversion: 2.1 time: 0.112260 Nov 02 12:36:16.352575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 418/818] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:16 2022] DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:16.361730 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:16.362455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:16.368317 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.368802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.369288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.370103 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:16.370564 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:16.370987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:16.504426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:16.512749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b4521715-19ad-4231-948f-8f72967b1ab6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1673 microversion: 2.1 time: 0.155250 Nov 02 12:36:16.513343 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 401/819] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:16 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:17.537513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:17.538199 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:17.545143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.545622 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.546055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.546739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:17.547192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:17.547613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:17.680900 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:17.688613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0be35d3e-c18e-4037-8d57-95c64cfc1f37 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1673 microversion: 2.1 time: 0.155319 Nov 02 12:36:17.689375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 419/820] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:17 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:18.707638 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.710519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.714192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.715873 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.718862 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.719362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.719940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.720899 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.721601 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.722238 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.724567 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.725058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.725649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.726720 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.727205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.727643 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.756565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f1a20e3e-1238-4f5d-a951-9bf950460da1 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052931 Nov 02 12:36:18.757459 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 402/821] 10.222.0.85 () {60 vars in 1343 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:18.802029 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:18.813626 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8ef78aa5-721b-4baf-9d54-d242d8225435 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1606 microversion: 2.1 time: 0.103332 Nov 02 12:36:18.814155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 420/822] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1606 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:18.851339 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.851850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.858557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.859113 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.859620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.860441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.860967 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.861531 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.887036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:18.969656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0893d27d-4659-4338-85ca-49f1651c5ac7 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 204 len: 0 microversion: 2.20 time: 0.121721 Nov 02 12:36:18.970652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 403/823] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:18 2022] DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:36:18.982185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:18.982939 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:18.990089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.990716 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.991218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:18.992014 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:18.992727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:18.993226 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.088142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f017e017-63a6-4bf5-9a99-ed0c3ac5cd59", "name": "network-vif-deleted", "tag": "6e038057-aa49-4208-9894-13991bb26bf9"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:19.099274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.099748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.100524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.114217 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] Creating event network-vif-deleted:6e038057-aa49-4208-9894-13991bb26bf9 for instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 on hv-cinder-86327 Nov 02 12:36:19.119300 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-5b24028a-4fa9-4ff6-9707-8c19e2452703 req-67ad2ef1-10fa-409a-8395-3b33e0f4faa9 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035080 Nov 02 12:36:19.123647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 404/824] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:36:19.141205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.149757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.151481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.153593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-112f7638-adf1-4bcc-afa8-2afb93a41ebc tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.176627 Nov 02 12:36:19.154927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 421/825] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:18 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:19.839452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:19.840375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:19.846838 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.847325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.847826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.848536 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:19.848990 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:19.849461 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:19.920055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aacb777ebdf445eca64d1e46c2bdeced', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5bc73b74407f4d6184cbd1330ee89145', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:19.928591 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b6855ea3-de9e-432f-8192-6d167316ea16 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 200 len: 1606 microversion: 2.1 time: 0.093912 Nov 02 12:36:19.929452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 405/826] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:19 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 1606 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:20.180044 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.180507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.187738 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.188247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.188673 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.190027 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.191406 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.191831 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.325939 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.335589 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.337137 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:20.338730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1c0d59b0-b2c8-433d-87bc-de16ce153fb2 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1722 microversion: 2.20 time: 0.162555 Nov 02 12:36:20.339409 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 422/827] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:20.954225 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:20.954944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:20.961701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.962185 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.962623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.963361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:20.963815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:20.964234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:20.979725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 HTTP/1.1 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:20.981429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:20.983072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f017e017-63a6-4bf5-9a99-ed0c3ac5cd59'} Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:20.984123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:20.989345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:20.990779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:20.990779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-439a8464-1725-4561-96c5-2998db10ac2c tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 404 len: 111 microversion: 2.1 time: 0.032528 Nov 02 12:36:20.990779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 406/828] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:20 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:20.993410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e2976f0d-b97e-4a5e-a6b5-34d21f573c95 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '.version_select at 0x7faf068d6a60>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.014374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e2976f0d-b97e-4a5e-a6b5-34d21f573c95 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-646614174" status: 202 len: 0 microversion: 2.1 time: 0.024962 Nov 02 12:36:21.018269 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 423/829] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Nov 2 12:36:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-646614174 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:36:21.365173 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:21.365795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:21.372200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.372681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.373449 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.374174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.374625 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.375043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.476877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.486701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.488141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '83593f8338c444b7b117eeaf3e4cdcd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62aa5934d5d14fdb81dd5d4817ab8e74', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:21.489344 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-46c9c74e-67a3-4a31-ba9a-0590db4e56ad tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 200 len: 1655 microversion: 2.20 time: 0.128397 Nov 02 12:36:21.489914 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 407/830] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:21 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 1655 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Nov 02 12:36:21.683230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f036557f-8699-4d06-ad2e-8c113952f2c4", "name": "network-vif-deleted", "tag": "7aa2d46a-71ec-44fe-9fbb-04e05370efef"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:21.708663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:21.713413 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:21.714097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:21.728593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] Creating event network-vif-deleted:7aa2d46a-71ec-44fe-9fbb-04e05370efef for instance f036557f-8699-4d06-ad2e-8c113952f2c4 on hv-cinder-86327 Nov 02 12:36:21.734321 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-742dcebc-5a02-465f-9fbb-bdc24037765c req-800ccbf8-7bf2-4e88-911f-84456f258d3e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055207 Nov 02 12:36:21.735506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 424/831] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:22.515582 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.516303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:22.522976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.523734 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.524170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.524874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:22.525353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:22.525773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:22.539924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 HTTP/1.1 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:22.541921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:22.543884 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f036557f-8699-4d06-ad2e-8c113952f2c4'} Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:22.544623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:22.547053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:22.548452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:22.548452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-cf36274b-7c25-4ec5-bcc3-c1c3c5ad1265 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 404 len: 111 microversion: 2.20 time: 0.031669 Nov 02 12:36:22.548452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 408/832] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:22 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:22.554307 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b6de312d-af36-4007-aa4a-b79b7c374b71 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '.version_select at 0x7faf06968940>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:22.574980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b6de312d-af36-4007-aa4a-b79b7c374b71 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-17663316" status: 204 len: 0 microversion: 2.20 time: 0.024886 Nov 02 12:36:22.575497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 425/833] 10.222.0.85 () {60 vars in 1256 bytes} [Wed Nov 2 12:36:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-17663316 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Nov 02 12:36:24.207067 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.207562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.213973 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.214447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.215371 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.216071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.216516 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.216932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.230179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 HTTP/1.1 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:24.232399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.233954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f017e017-63a6-4bf5-9a99-ed0c3ac5cd59'} Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:24.234826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.236253 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.237731 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:24.237731 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2311d1e7-9404-49dc-92fb-a3212f7e5af6 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 404 len: 111 microversion: 2.1 time: 0.030555 Nov 02 12:36:24.237731 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 409/834] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:24 2022] DELETE /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:24.243186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.243983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: f017e017-63a6-4bf5-9a99-ed0c3ac5cd59] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.251088 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.251570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.252008 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.252690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.253192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.253657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.267126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 HTTP/1.1 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:36:24.268822 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.270535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'f017e017-63a6-4bf5-9a99-ed0c3ac5cd59'} Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:24.271310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. Nov 02 12:36:24.272497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.273573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:24.273573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2fa4ec13-d211-4622-812a-115265236907 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59" status: 404 len: 111 microversion: 2.1 time: 0.031808 Nov 02 12:36:24.273573 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 426/835] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/f017e017-63a6-4bf5-9a99-ed0c3ac5cd59 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:24.366087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.366586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.372435 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.373367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.373655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.378482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.378482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.378482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.388832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 HTTP/1.1 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:24.390394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.392018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f036557f-8699-4d06-ad2e-8c113952f2c4'} Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:24.392908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.394433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.395881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:24.395881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-017dba10-e8c2-4e16-94fe-73a7a905f9ec tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 404 len: 111 microversion: 2.20 time: 0.029559 Nov 02 12:36:24.395881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 410/836] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:24 2022] DELETE /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:24.400693 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.401391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: f036557f-8699-4d06-ad2e-8c113952f2c4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.408263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.408771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.409272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.410013 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.410487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.410955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.425383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 HTTP/1.1 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:36:24.427026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.428681 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'f036557f-8699-4d06-ad2e-8c113952f2c4'} Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:24.429580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. Nov 02 12:36:24.431081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:24.432520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance f036557f-8699-4d06-ad2e-8c113952f2c4 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:24.432520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c878c26d-9868-40f4-8929-880a21f9ee12 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4" status: 404 len: 111 microversion: 2.20 time: 0.032110 Nov 02 12:36:24.432520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 427/837] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/f036557f-8699-4d06-ad2e-8c113952f2c4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Nov 02 12:36:24.971596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:24.972008 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:24.978132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.978615 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.979054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:24.979742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:24.980196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:24.980647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.004107 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e37e2d01-a0fb-4397-91eb-43acd4103b80 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/ips" status: 200 len: 149 microversion: 2.1 time: 0.036436 Nov 02 12:36:25.004673 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 411/838] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:36:24 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:25.418568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.419055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.425675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.426168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.426590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.427268 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.427720 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.428141 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.442405 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f HTTP/1.1 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:36:25.443958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.445489 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '4e473906-98d3-4493-8449-d57838bdae8f'} Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.446397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.447845 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.449319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.449319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f979df6-b822-4ac0-84c0-2179f56212f7 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 404 len: 111 microversion: 2.1 time: 0.031116 Nov 02 12:36:25.449319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 428/839] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:25 2022] DELETE /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:25.454881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.455484 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] [instance: 4e473906-98d3-4493-8449-d57838bdae8f] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.461894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.462364 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.462788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.463468 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.463947 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.464367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.477820 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] HTTP exception thrown: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Request method failure captured: Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f HTTP/1.1 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmL0xbRRlvTJ-TDJuECjEo3kFFmPNWewrOTpKTjroh79m3CP5op7MdeqU_1VG6PQItjlAdBlzL3XD12yI063LcofjDjFgPaI2CYj0jdomffq1pboYiE0TAfY9VFVX5QLIM6eB6tvouvFXTEfEvYRpwxXVVZ3qMZbZOcCqPmS4j2aFFA Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:25.479265 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/5bc73b74407f4d6184cbd1330ee89145"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 5bc73b74407f4d6184cbd1330ee89145 Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1192731604 Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: aacb777ebdf445eca64d1e46c2bdeced Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeTestJSON-1192731604-project Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.481483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '4e473906-98d3-4493-8449-d57838bdae8f'} Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.482421 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. Nov 02 12:36:25.483865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.485249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] Returning 404 to user: Instance 4e473906-98d3-4493-8449-d57838bdae8f could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.485249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-00d81aad-62fb-40cd-8abb-34a7194a73a8 tempest-AttachVolumeTestJSON-1192731604 tempest-AttachVolumeTestJSON-1192731604-project] 10.222.0.85 "GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f" status: 404 len: 111 microversion: 2.1 time: 0.029613 Nov 02 12:36:25.485249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 412/840] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/4e473906-98d3-4493-8449-d57838bdae8f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:25.574367 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.575293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.581719 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.582436 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.583374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.584431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.585089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.585541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.600161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 HTTP/1.1 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:36:25.601763 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.603452 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'c684f91d-7d77-4303-99ad-d73b293539a4'} Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.604236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.606175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.607714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.607714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9422355c-2261-4761-90bb-fe11f76b7972 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 404 len: 111 microversion: 2.20 time: 0.032901 Nov 02 12:36:25.607714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 429/841] 10.222.0.85 () {60 vars in 1280 bytes} [Wed Nov 2 12:36:25 2022] DELETE /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:25.613140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:25.613881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] [instance: c684f91d-7d77-4303-99ad-d73b293539a4] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:25.620363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.620532 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.621020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.622406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:25.623251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:25.623677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:25.638310 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] HTTP exception thrown: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Request method failure captured: Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 HTTP/1.1 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmKW9KYZQCjeGKpDn4skyH1maAh9MDXxoPLaK9sl2zF7Pia7wW1IjDjIvGi4R-TWuaPZ_r7WLgY97QMNR9qDlIPEGwUuaFT04x6Od5HZ1MTy0iVE7FnrIk9G5hTSwbB3m_afhr2kvhuqReb1WA3EJcdIcawa966wOWUccrg-csQT8so Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Openstack-Nova-Api-Version: 2.20 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:36:25.639863 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/62aa5934d5d14fdb81dd5d4817ab8e74"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 62aa5934d5d14fdb81dd5d4817ab8e74 Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-353443343 Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: 83593f8338c444b7b117eeaf3e4cdcd5 Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeShelveTestJSON-353443343-project Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.641345 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'c684f91d-7d77-4303-99ad-d73b293539a4'} Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:25.642262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. Nov 02 12:36:25.643761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:36:25.645095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] Returning 404 to user: Instance c684f91d-7d77-4303-99ad-d73b293539a4 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:25.645095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-74f024a5-7a86-4626-9c2a-68cf016a9e31 tempest-AttachVolumeShelveTestJSON-353443343 tempest-AttachVolumeShelveTestJSON-353443343-project] 10.222.0.85 "GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4" status: 404 len: 111 microversion: 2.20 time: 0.032287 Nov 02 12:36:25.645095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 413/842] 10.222.0.85 () {60 vars in 1277 bytes} [Wed Nov 2 12:36:25 2022] GET /compute/v2.1/servers/c684f91d-7d77-4303-99ad-d73b293539a4 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:36:26.376459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38a29b70-fb1e-4821-8112-51f4985017f3"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:26.379080 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:26.385299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.385794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.386228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.387456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:26.387913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:26.388340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:26.692776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-89cebad8-cf0c-4633-a895-4deacebc43ba tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.319846 Nov 02 12:36:26.693595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 430/843] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:36:26 2022] POST /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments => generated 194 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:30.813285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:30.813993 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:30.814369 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:30.822829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.823088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.823356 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.828966 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.829443 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:30.830022 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.830451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.831729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:30.835850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:30.844472 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] Creating event network-changed:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:36:30.850059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-a525f21b-0dab-43d9-91d7-5203b45345e4 req-91a06fec-675c-4357-948b-a4aebfdfe73a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042340 Nov 02 12:36:30.850963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 431/844] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:30.883871 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:36:30.926285 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:31.041391 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d194f3f5-8a41-4b09-8869-2aa1da360b10 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "DELETE /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 204 len: 0 microversion: 2.1 time: 0.237941 Nov 02 12:36:31.043293 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 414/845] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:36:30 2022] DELETE /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:36:31.061483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:31.064373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:31.086378 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.088052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.089269 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.090633 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:31.091738 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:31.094448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:31.137528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:31.315085 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:31.323116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-78333d98-6701-4c3a-8da3-9ae027f50264 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.274644 Nov 02 12:36:31.338487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 432/846] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:31 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:32.349521 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:32.351508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:32.360880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.362238 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.362898 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.363789 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:32.364425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:32.365068 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:32.543710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:32.553206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d5129d2f-55aa-4a86-99bc-58b9867662bf tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1569 microversion: 2.1 time: 0.208983 Nov 02 12:36:32.554468 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 415/847] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:32 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:33.420519 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-56a0f39b-7fe5-4802-b54c-e6ec9b7da509 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: .version_select at 0x7faf0686f430>, body: {"keypair": {"name": "tempest-keypair-112232025", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIXWsgWJ2+SHdsY8lFmI9nFABO4ynwwJ/TO/yusizqVdFEEyHsu1rJOM7lDusm6AyHSS60OoZiQA1cU4jR/BbaMoCV2PRHdEyaEsDHCe/52ASLEm8Au4KQu8oxRWBTIEHA=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:33.436869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-56a0f39b-7fe5-4802-b54c-e6ec9b7da509 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:33.441224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-56a0f39b-7fe5-4802-b54c-e6ec9b7da509 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:33.463175 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-56a0f39b-7fe5-4802-b54c-e6ec9b7da509 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047193 Nov 02 12:36:33.463783 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 433/848] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:36:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:33.578675 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:33.579986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:33.586595 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.587497 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.588133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.589054 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.590427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.591085 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.946722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b59ad8ab-195e-4736-8bb9-c44d17f23e5c", "name": "network-vif-deleted", "tag": "87e694b5-8f11-43e5-a848-417df7df3b22"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:33.954277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:33.963120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:33.963795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:33.964846 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:33.977926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] Creating event network-vif-deleted:87e694b5-8f11-43e5-a848-417df7df3b22 for instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c on hv-cinder-86327 Nov 02 12:36:33.981755 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:33.984950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-167a410b-98dc-4311-a2e1-da6066b38cdc req-b4a404ef-73a6-47b5-b1da-b1b03d43a899 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045188 Nov 02 12:36:33.985941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 434/849] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:33.991283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c7301a01-e922-4c95-8fbd-0bc05a0102b3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1450 microversion: 2.1 time: 0.417682 Nov 02 12:36:33.992134 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 416/850] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:33 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1450 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:35.018256 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:35.019727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:35.027023 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.027837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.028270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.029736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:35.030393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:35.031038 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:35.128614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:35.138068 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5e86b19e-c192-44f3-b218-09e4b43cab38 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1220 microversion: 2.1 time: 0.124882 Nov 02 12:36:35.139344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 435/851] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:35 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1220 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:35.293120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1684242353", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "131d0da7-02ff-497d-ba38-17a9c0dcd040"}], "security_groups": [{"name": "tempest-securitygroup--343881556"}], "key_name": "tempest-keypair-112232025", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:35.301856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:35.408546 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] validate_networks() for [('131d0da7-02ff-497d-ba38-17a9c0dcd040', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:36:36.065026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:36:36.065452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:36:36.066406 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:36:36.067419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:36:36.067419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:36:36.077284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.077766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.078196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.078944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.079380 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.079800 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.097698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:36:36.101504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:36:36.113122 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:36:36.115529 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:36:36.161328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:36.161939 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:36.168901 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.169412 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.169848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.170539 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:36.170980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:36.171445 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:36.181617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9697b857-5e0d-4836-9180-70ca508226b5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.893146 Nov 02 12:36:36.182554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 417/852] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:36:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 895 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:36:36.201145 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-72cb9f99-0490-46c0-9082-c83fc549777a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:36.201994 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-72cb9f99-0490-46c0-9082-c83fc549777a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:36.267802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:36.282592 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5b1d6e5d-6427-418f-b68e-89264c9413e3 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1220 microversion: 2.1 time: 0.124933 Nov 02 12:36:36.283434 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-72cb9f99-0490-46c0-9082-c83fc549777a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:36.283580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 436/853] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:36 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1220 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:36.294270 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-72cb9f99-0490-46c0-9082-c83fc549777a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1241 microversion: 2.1 time: 0.098881 Nov 02 12:36:36.294948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 418/854] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:36 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1241 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:37.311197 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:37.311955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:37.324624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:37.326010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:37.333677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.334506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.335128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.336160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.336811 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.337665 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.347670 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.348347 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.349224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.350020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.350595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.351273 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.416337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:37.419796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:37.420418 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:37.421171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lazy-loading 'fault' on Instance uuid b59ad8ab-195e-4736-8bb9-c44d17f23e5c {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:36:37.491392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '20a4049d2b2b474a8a830d0702b9b1fa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '620e39db57f34948b5450e5b90c984cb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:37.500843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d0a4fa51-e8c4-4fcb-89a1-996c5193f8aa tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 200 len: 1225 microversion: 2.1 time: 0.196606 Nov 02 12:36:37.501444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 437/855] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:37 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 1225 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:37.543299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:37.559483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7c6c98bb-270a-40af-bd4c-ac8a7c9695d7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1301 microversion: 2.1 time: 0.240036 Nov 02 12:36:37.561552 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 419/856] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:37 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1301 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:38.535678 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.536294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] [instance: b59ad8ab-195e-4736-8bb9-c44d17f23e5c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:38.543631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.544383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.544983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.545719 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.546168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.546830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.561130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] HTTP exception thrown: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Request method failure captured: Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c HTTP/1.1 Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmMCSxfHbabiwIdlvnLfdq93xzifJDDbYNig4Ir3miSDpTF0M40lD0IL07UrurouG6ffIazKQYTTroix2hpJuBkjYb7J1QmKlUPQIKtyHMrK3ct6INULiju9yxiDMlIjINem6Z7S_H8dz29S2yyf2Jz_HqeUHxXW9JZpldLkY2qmsTU Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 620e39db57f34948b5450e5b90c984cb Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestShelveInstance-928485621 Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:36:38.563157 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_620e39db57f34948b5450e5b90c984cb"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/620e39db57f34948b5450e5b90c984cb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/620e39db57f34948b5450e5b90c984cb"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/620e39db57f34948b5450e5b90c984cb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestShelveInstance-928485621 Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 620e39db57f34948b5450e5b90c984cb Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestShelveInstance-928485621 Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-TestShelveInstance-928485621-project Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 20a4049d2b2b474a8a830d0702b9b1fa Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestShelveInstance-928485621-project Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. Nov 02 12:36:38.564839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'b59ad8ab-195e-4736-8bb9-c44d17f23e5c'} Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:36:38.565732 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. Nov 02 12:36:38.567041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:36:38.569910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Returning 404 to user: Instance b59ad8ab-195e-4736-8bb9-c44d17f23e5c could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:36:38.570776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-a712b4e6-02b1-42ed-961a-74a8f8ca353d tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c" status: 404 len: 111 microversion: 2.1 time: 0.039559 Nov 02 12:36:38.571348 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 438/857] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/servers/b59ad8ab-195e-4736-8bb9-c44d17f23e5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:36:38.592076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.598831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:38.616227 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.616984 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.617734 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.619179 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:38.620810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:38.621471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:38.780527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:38.788575 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-276dc17e-44ea-4ab5-a199-d2055116346e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.203106 Nov 02 12:36:38.793099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 420/858] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:38 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:38.794130 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0470b820-6c8d-4348-b03a-beee44510086 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] Calling method '.version_select at 0x7faf06880ee0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:38.829433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0470b820-6c8d-4348-b03a-beee44510086 tempest-TestShelveInstance-928485621 tempest-TestShelveInstance-928485621-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1697924631" status: 202 len: 0 microversion: 2.1 time: 0.040335 Nov 02 12:36:38.830291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 439/859] 10.222.0.85 () {58 vars in 1254 bytes} [Wed Nov 2 12:36:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1697924631 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:36:39.815039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:39.816224 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:39.822779 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.823308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.824259 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:39.825347 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:39.826194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:39.826714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:40.064760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:40.075643 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-691c1d5d-71a5-43ea-912a-20e5bc78cd9b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.263989 Nov 02 12:36:40.076220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 421/860] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:39 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:41.099279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:41.100513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:41.116892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:41.117619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:41.118217 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:41.119091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:41.119557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:41.119979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:41.332635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:41.347527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6e4299b2-388a-499b-b936-b2272821dff7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.252419 Nov 02 12:36:41.348281 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 440/861] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:41 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:42.208695 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e034cdd-9d61-4dd9-9a05-f17b722a9fdb", "tag": "0f9c0392-6d3a-4042-8f7f-1f9f25757495"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:42.224039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.224694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.225281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.242320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] Creating event network-changed:0f9c0392-6d3a-4042-8f7f-1f9f25757495 for instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb on hv-cinder-86327 Nov 02 12:36:42.248831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-5e95d054-b28a-42c6-afb0-1df6942fe442 req-8f0a3c4b-febe-440f-b254-3d1b0d72d8d4 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045323 Nov 02 12:36:42.250481 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 422/862] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:42.375603 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:42.376247 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:42.390337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.390841 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.391488 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.392499 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:42.393786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:42.394407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:42.662495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:42.677905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b6b49975-eb13-4abf-b22f-c183b128de3d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.311157 Nov 02 12:36:42.678708 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 441/863] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:42 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:43.708364 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:43.709155 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:43.715667 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.716329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.716839 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:43.717573 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:43.718022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:43.718441 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:43.849881 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:43.858200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-fe7925c4-6c2f-490f-9fe0-cf3633887076 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.154509 Nov 02 12:36:43.858860 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 423/864] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:43 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:44.880948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:44.881680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:44.885389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:44.890465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.891041 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.891542 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:44.892315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:44.892830 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:44.893344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:45.082362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:45.101566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7d60dba0-1686-493f-a44a-f62ca3e7e0b7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.224315 Nov 02 12:36:45.102161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 442/865] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:44 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:46.125219 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:46.126044 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:46.130911 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:46.136572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.137156 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.137591 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.138316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:46.138761 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:46.139361 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:46.275920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:46.284175 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-ca1302dd-03d6-40f7-9c10-527ab11c5c7c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.164234 Nov 02 12:36:46.290286 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 424/866] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:46 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:47.309891 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:47.310774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:47.318047 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.318561 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.319040 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.319842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:47.320294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:47.320758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:47.458686 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:47.467228 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-04fceb88-edb0-43c6-93f6-ebe41f591b1b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.163402 Nov 02 12:36:47.467805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 443/867] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:47 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:48.490296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:48.490911 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:48.492776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=8 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:36:48.499235 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.499711 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.500140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.500825 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:48.501300 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:48.501716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:48.638351 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:48.646437 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-03211af8-a5ae-4082-a4f1-fdd8efdf9c40 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.160137 Nov 02 12:36:48.647018 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 425/868] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:48 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:49.671881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:49.672490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:49.678820 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.679299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.679726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.680404 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:49.680848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:49.681291 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:49.812435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:49.819987 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d61e91cb-585f-483f-b114-5ab7baf782d1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.152027 Nov 02 12:36:49.820552 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 444/869] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:49 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:50.845206 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:50.845795 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:50.852158 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.852631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.853086 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:50.853773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:50.854220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:50.854635 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:50.984877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:50.993753 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-61b118f2-41f3-410f-aa7e-ecb22ab39fd4 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.153495 Nov 02 12:36:50.994322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 426/870] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:50 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:52.017117 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:52.017759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:52.024217 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.024699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.025179 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.025881 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:52.026381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:52.026809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:52.155805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:52.163531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-da417f0b-e0d9-4ce1-a7e4-f01e2c276da2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.150302 Nov 02 12:36:52.164383 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 445/871] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:52 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:53.187396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:53.188013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:53.194745 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.195281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.195831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:53.197276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:53.197276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:53.197544 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:53.347785 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:53.355836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8e4e2dd0-1458-4ae0-b26d-7d52da0d7b17 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.172485 Nov 02 12:36:53.356399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 427/872] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:53 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:54.379566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:54.380180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:54.386668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.388052 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.388937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.389430 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.389858 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.538087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:54.548098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3ba59b8c-2b25-4794-a4a5-e34b0d77206d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.172280 Nov 02 12:36:54.548714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 446/873] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:54 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:54.655732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e034cdd-9d61-4dd9-9a05-f17b722a9fdb", "name": "network-vif-plugged", "status": "completed", "tag": "0f9c0392-6d3a-4042-8f7f-1f9f25757495"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:36:54.667723 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:54.668422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:54.669433 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:54.682165 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] Creating event network-vif-plugged:0f9c0392-6d3a-4042-8f7f-1f9f25757495 for instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb on hv-cinder-86327 Nov 02 12:36:54.688428 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-b4c6f15e-6fa1-4909-847e-66aad7b6ca84 req-5595962f-ac5f-4500-b006-52909c2f6b2e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037681 Nov 02 12:36:54.690070 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 428/874] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:36:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:36:55.572867 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:55.573825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:55.580466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:55.580959 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:55.581426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:55.582315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:55.582789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:55.583212 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:55.759994 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:55.768391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2af1c2c2-4364-4b71-999b-f3aea149b408 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.200511 Nov 02 12:36:55.769448 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 447/875] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:55 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:56.793550 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:56.794264 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:56.800733 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.801281 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.801721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.802430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:56.802887 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:56.803313 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:56.951289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:56.958839 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-763dcf4e-24cb-4df8-af04-52f8b39e569b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.170791 Nov 02 12:36:56.959397 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 429/876] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:56 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:57.982669 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:57.983965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:57.990224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.990699 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.991127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:57.991810 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:57.992256 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:57.992778 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:58.122791 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:58.130399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8e4f8b89-af47-4ade-b59b-9b50c7a42768 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1366 microversion: 2.1 time: 0.152222 Nov 02 12:36:58.130957 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 448/877] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:57 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:36:59.152950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.153572 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:59.160236 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.160720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.161205 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.161903 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.162352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.162793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.296498 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:36:59.304132 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a9e4ec70-d9b8-42fc-a185-bf9bed6ef90c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1555 microversion: 2.1 time: 0.155117 Nov 02 12:36:59.304708 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 430/878] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:36:59.327507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:36:59.328025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:36:59.334216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.334694 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.335123 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.335807 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:36:59.336258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:36:59.336668 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:36:59.418899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7e511a5d-8ce5-4d5b-a948-fd3b45b4f111 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096036 Nov 02 12:36:59.419697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 449/879] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:36:59 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:00.441611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4e034cdd-9d61-4dd9-9a05-f17b722a9fdb", "tag": "0f9c0392-6d3a-4042-8f7f-1f9f25757495"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:00.461525 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:00.462101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:00.462535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:00.476079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] Creating event network-changed:0f9c0392-6d3a-4042-8f7f-1f9f25757495 for instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb on hv-cinder-86327 Nov 02 12:37:00.481633 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-9d3bc9ec-e25d-4af3-8efa-5ccbc25febab req-de6f9cca-0d23-4766-8837-22b0c2c6a7da service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044472 Nov 02 12:37:00.482241 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 431/880] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:20.668747 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:20.669515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=85 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:20.901370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3611ebbb-b281-472f-93d3-a2785e6b0582 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Action: 'create', calling method: .version_select at 0x7faf06923ee0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1055812514", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKx3IiYX784h9TXCM+OL64sLUc8Hv73A8N0yeews5dyyGW+MkcLxUtFftMi7CvMcgurvTLE18E90Kkg7bv9AKz3pZGerAkPEYXQVQedZlPcOL7oisDRym6RQhJvSlPk0/g=="}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:20.917915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-3611ebbb-b281-472f-93d3-a2785e6b0582 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Getting quotas for project 2b3b8f23a66e4540a0f65330c6d6496e. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:20.922108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-3611ebbb-b281-472f-93d3-a2785e6b0582 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Getting quotas for user ff4810b8d4ef4c80a47b3208ce5439d5 and project 2b3b8f23a66e4540a0f65330c6d6496e. Resources: {'key_pairs'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:20.945386 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3611ebbb-b281-472f-93d3-a2785e6b0582 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.278167 Nov 02 12:37:20.946097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 450/881] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:37:20 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:33.918329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:33.918995 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.921448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.922188 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=84,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.928105 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.928593 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.929046 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.929751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.930403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.930848 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.958031 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7f693978-0415-44a1-b544-1b4cf9ff79ab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/ips" status: 200 len: 149 microversion: 2.1 time: 0.044682 Nov 02 12:37:33.958631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 432/882] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:37:33 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/ips => generated 149 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:33.970806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=4 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.971623 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:33.976513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38a29b70-fb1e-4821-8112-51f4985017f3"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:33.979025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:33.988753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.989187 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.989627 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:33.990339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:33.990792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:33.991214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.082737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/os-volume_attachments HTTP/1.1 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 74 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:37:34.084373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {"volumeAttachment": {"volumeId": "38a29b70-fb1e-4821-8112-51f4985017f3"}} Nov 02 12:37:34.088645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'server_id': '4e034cdd-9d61-4dd9-9a05-f17b722a9fdb', 'body': {'volumeAttachment': {'volumeId': '38a29b70-fb1e-4821-8112-51f4985017f3'}}} Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:34.089862 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:34.091646 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 400 to user: Invalid volume: volume 38a29b70-fb1e-4821-8112-51f4985017f3 is already attached to instances: f2df250e-1726-4f54-a16d-759cf7372159 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1c658b10-130c-4794-92a2-acc1fe2219a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.117084 Nov 02 12:37:34.093631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 451/883] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:37:33 2022] POST /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb/os-volume_attachments => generated 174 bytes in 119 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:37:34.095878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:34.096373 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:34.103193 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.103674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.104104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.104815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.105297 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.105716 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.135251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:34.214649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-96f768cf-1f49-48bf-80fc-5945a41e29e5 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 204 len: 0 microversion: 2.1 time: 0.122204 Nov 02 12:37:34.215306 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 433/884] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:34 2022] DELETE /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:34.224491 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:34.225294 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:34.232069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.232548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.233010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.233727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:34.234179 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:34.234599 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:34.419513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:34.427225 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a5170ef-01ac-460d-8325-1d0d6679644c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1680 microversion: 2.1 time: 0.207310 Nov 02 12:37:34.427882 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 452/885] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:34 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1680 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:35.454894 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:35.455801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:35.463576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.464078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.464512 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.465255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:35.465712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:35.466133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:35.632048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:35.640708 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f5a3f2e4-dda0-492f-bb73-81bcb2759dcb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1680 microversion: 2.1 time: 0.192338 Nov 02 12:37:35.641331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 434/886] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:35 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1680 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:36.673821 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:36.674438 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:36.683979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.684543 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.685079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.686057 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.686606 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.687095 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.758229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:36.767376 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-04f2bdca-dff0-4692-906c-59f86c6ac972 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1613 microversion: 2.1 time: 0.101435 Nov 02 12:37:36.770796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 453/887] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:36 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1613 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:36.947867 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4e034cdd-9d61-4dd9-9a05-f17b722a9fdb", "name": "network-vif-deleted", "tag": "0f9c0392-6d3a-4042-8f7f-1f9f25757495"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:36.963951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:36.963951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:36.963951 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:36.976222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] Creating event network-vif-deleted:0f9c0392-6d3a-4042-8f7f-1f9f25757495 for instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb on hv-cinder-86327 Nov 02 12:37:36.982778 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-ebe29e65-c78a-4900-8c03-19c08eef65af req-dda63289-1305-4ae3-beae-a29f7fe82988 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038768 Nov 02 12:37:36.983808 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 435/888] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:37.795871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:37.797493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:37.809054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.809958 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.810889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.813216 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.813892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.814548 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.865805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:37.867244 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:37.868806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:37.869463 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'fault' on Instance uuid 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:37.945132 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:37.963378 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3f441946-4684-4aa5-912a-6129a14f8977 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 200 len: 1331 microversion: 2.1 time: 0.175865 Nov 02 12:37:37.965833 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 454/889] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:37 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 1331 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:38.827094 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1041141213", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1055812514", "security_groups": [{"name": "tempest-secgroup-smoke-1502145944"}], "block_device_mapping_v2": [{"uuid": "e786350d-c74c-4f60-9411-3324cbb03c7a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ddb6a3cc-6e95-4961-ab2a-9916cfc7f6dc"}]}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:38.968949 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] validate_networks() for [('ddb6a3cc-6e95-4961-ab2a-9916cfc7f6dc', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:38.989575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:38.990200 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:38.997256 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.997735 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.998163 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:38.999051 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:38.999523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:38.999947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.014553 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb HTTP/1.1 Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:37:39.016104 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:37:39.017746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '4e034cdd-9d61-4dd9-9a05-f17b722a9fdb'} Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:39.018659 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:37:39.020087 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:37:39.021368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:39.021368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ac0a6d9b-bf65-492c-988d-6411c9eea63b tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 404 len: 111 microversion: 2.1 time: 0.032354 Nov 02 12:37:39.021368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 455/890] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:38 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:37:39.026941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-61105356-5871-4025-9ac5-219b44a7c190 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '.version_select at 0x7faf068375e0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:39.049252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-61105356-5871-4025-9ac5-219b44a7c190 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-112232025" status: 202 len: 0 microversion: 2.1 time: 0.025309 Nov 02 12:37:39.049932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 456/891] 10.222.0.85 () {58 vars in 1218 bytes} [Wed Nov 2 12:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-112232025 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:37:39.397968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:39.398707 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:39.399467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:39.400080 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:39.400501 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:39.410072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.410562 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.411162 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.411902 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.412357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.412780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.436458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Getting quotas for project 2b3b8f23a66e4540a0f65330c6d6496e. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:39.440624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Getting quotas for user ff4810b8d4ef4c80a47b3208ce5439d5 and project 2b3b8f23a66e4540a0f65330c6d6496e. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:39.503115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:39.505393 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e786350d-c74c-4f60-9411-3324cbb03c7a',volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:39.652760 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-c180e1c3-c7c7-4cb3-ae1b-030387c511a6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.830478 Nov 02 12:37:39.653456 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 436/892] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:39.665520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-216d35ac-51bc-4292-9f21-0579a727d81d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:39.666484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-216d35ac-51bc-4292-9f21-0579a727d81d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:39.757805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-216d35ac-51bc-4292-9f21-0579a727d81d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:39.769981 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-216d35ac-51bc-4292-9f21-0579a727d81d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1095 microversion: 2.1 time: 0.108985 Nov 02 12:37:39.770557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 457/893] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:39 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1095 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:39.850705 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:39.851419 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:39.860191 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.860770 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.861249 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.861964 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:39.862420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:39.862848 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:39.950864 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'services' on Instance uuid f2df250e-1726-4f54-a16d-759cf7372159 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:40.033613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-38eae997-8a6d-4f36-9896-36cb5d6dd4f7 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments/38a29b70-fb1e-4821-8112-51f4985017f3" status: 202 len: 0 microversion: 2.1 time: 0.189284 Nov 02 12:37:40.034535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 437/894] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:37:39 2022] DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments/38a29b70-fb1e-4821-8112-51f4985017f3 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:40.044889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.047270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.056886 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.057589 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.058035 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.058741 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.059356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.059782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.117474 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-721703c9-b24c-4f8b-bd96-1830241d4859 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.077528 Nov 02 12:37:40.118285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 458/895] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:37:40 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:40.794019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:40.794790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:40.800952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.801506 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.801987 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.802905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:40.803407 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:40.803828 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:40.872748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:40.880711 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-057e02d3-b97e-4b5c-b51a-cbc834ab6eac tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1193 microversion: 2.1 time: 0.090933 Nov 02 12:37:40.881307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 438/896] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:40 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1193 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:41.130523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.134272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.141265 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.141752 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.142246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.142952 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.143399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.143818 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.176202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f3b99be4-2093-4012-91b2-8b7dc475f7db tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049861 Nov 02 12:37:41.176776 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 459/897] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:37:41.245807 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.247101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.253254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.253816 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.254305 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.255229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.255738 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.256357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.282058 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:37:41.361784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bb3dc674-1db9-44c7-a002-3685202d9a79 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 204 len: 0 microversion: 2.1 time: 0.120084 Nov 02 12:37:41.362681 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 439/898] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:37:41 2022] DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:37:41.373913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.374575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.381914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.382402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.382856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.384169 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.384617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.385055 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.537920 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:41.546370 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-19f74019-7d99-4756-b070-c29c8fb0bd97 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1681 microversion: 2.1 time: 0.179222 Nov 02 12:37:41.546948 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 460/899] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:41.905087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:41.905788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:41.912176 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.912656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.913119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:41.913804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:41.914982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:41.915485 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.051260 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:42.059725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-546b08c1-ed69-4142-a69f-bfd80dd2e644 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1279 microversion: 2.1 time: 0.159153 Nov 02 12:37:42.060453 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 440/900] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:41 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1279 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:42.573477 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:42.575609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:42.582280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.582787 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.583202 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.583916 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:42.584369 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:42.584790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:42.729330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:42.738534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-de41d66d-58c2-4476-b281-313b28c189dc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1681 microversion: 2.1 time: 0.170845 Nov 02 12:37:42.739481 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 461/901] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:42 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1681 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:43.083817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:43.084783 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:43.091426 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.091939 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.092408 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.093182 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.093660 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.094109 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.421262 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:43.433064 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-3f6d8caa-2930-4313-9528-9a98dea31fba tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.353658 Nov 02 12:37:43.434073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 441/902] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:43 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:43.763250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:43.763955 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:43.771264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.771759 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.772198 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.772921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.774129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.774764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.781135 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16706f7a-636d-4b12-aa14-8a3c7a65622c", "tag": "83ebf17f-897d-4acb-afb7-aa488ae074e3"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:43.791274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:43.792055 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:43.792576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:43.807145 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] Creating event network-changed:83ebf17f-897d-4acb-afb7-aa488ae074e3 for instance 16706f7a-636d-4b12-aa14-8a3c7a65622c on hv-cinder-86327 Nov 02 12:37:43.812507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-cfbf8757-8683-41ad-9ec0-414fc25041ed req-eaa36961-4b80-4c36-a731-812f7cf6425c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035064 Nov 02 12:37:43.813496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 442/903] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:37:43.957758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:43.968171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-833ad034-b2d9-4db3-8a13-8890f1bbe2c8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1681 microversion: 2.1 time: 0.208899 Nov 02 12:37:43.968843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 462/904] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:43 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1681 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:44.458070 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:44.458917 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:44.471210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.471960 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.472231 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:44.472946 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:44.473427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:44.473850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:44.803274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:44.813060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-40b8eb53-32b5-4bc0-a2cc-3f347f0578ff tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.359533 Nov 02 12:37:44.814307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 443/905] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:44 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:44.993525 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:44.994126 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.001229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.001991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.002588 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.003515 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.004737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.005566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.053836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.055546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.056116 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.057195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'fault' on Instance uuid f2df250e-1726-4f54-a16d-759cf7372159 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:37:45.130513 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:45.149727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b776f2da-e4ba-4e8e-810e-186a9a06ebbb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 200 len: 1331 microversion: 2.1 time: 0.160701 Nov 02 12:37:45.151926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 463/906] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:44 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 1331 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:45.833766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2df250e-1726-4f54-a16d-759cf7372159", "name": "network-vif-deleted", "tag": "37793e4a-f37f-4d9f-836a-8413dc503ee1"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:45.843827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:45.845274 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:45.848504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.849309 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.849947 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.853334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.854059 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.854727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.855267 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:45.856010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:45.856454 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:45.868401 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] Creating event network-vif-deleted:37793e4a-f37f-4d9f-836a-8413dc503ee1 for instance f2df250e-1726-4f54-a16d-759cf7372159 on hv-cinder-86327 Nov 02 12:37:45.874392 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-089b4ffb-0f16-478d-8bd1-5dc39e8eaaf6 req-3552ca78-4ea5-417e-993d-93f22d368133 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044836 Nov 02 12:37:45.876057 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 444/907] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:46.056338 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:46.064809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d45e3c17-630b-4011-b47c-672701ce2ad5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.226893 Nov 02 12:37:46.065486 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 464/908] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:45 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:46.174997 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:46.175698 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:46.181836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.182510 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.183129 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.183831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:46.184283 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:46.184717 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:46.198702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 HTTP/1.1 Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:37:46.200333 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:37:46.201952 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f2df250e-1726-4f54-a16d-759cf7372159'} Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:37:46.203097 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:37:46.204473 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:37:46.206174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:37:46.206174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-419232b4-a970-4cb0-86d0-b70fdfa74654 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 404 len: 111 microversion: 2.1 time: 0.030963 Nov 02 12:37:46.206174 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 445/909] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:46 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:37:46.212328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-22f19050-d3d4-4f44-a444-152b26e2b2ed tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '.version_select at 0x7faf0699f430>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:46.231015 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-22f19050-d3d4-4f44-a444-152b26e2b2ed tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336369031" status: 202 len: 0 microversion: 2.1 time: 0.023096 Nov 02 12:37:46.231590 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 465/910] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Nov 2 12:37:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1336369031 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:37:46.945549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: .version_select at 0x7faf068844c0>, body: {"keypair": {"name": "tempest-keypair-1625450988", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE6TSpVukV4/XgsKe9UZmfuO4tcegyvf/1WKoTGkFdzl+k/BPqNyQ0O1Osu58ud8rE7bJ91M6s07DinJ/xWCgKzhzj9phQFe20guProezprDgH/RVpTDmPRvlwpfoA+hPA=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:46.962002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:46.965836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:46.978092 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR oslo.messaging._drivers.impl_rabbit [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [a6e8b20e-9b45-4ec7-898e-0335cbbc91c4] AMQP server on 10.222.0.85:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Nov 02 12:37:47.089546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:47.090648 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:47.096687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.097208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.097644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.098327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:47.098777 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:47.099192 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:47.240207 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:47.248121 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-00f74196-a722-434e-9813-761183d053cb tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.164225 Nov 02 12:37:47.249025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 466/911] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:47 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:47.985729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [a6e8b20e-9b45-4ec7-898e-0335cbbc91c4] Reconnected to AMQP server on 10.222.0.85:5672 via [amqp] client with port 36906. Nov 02 12:37:48.002624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2d2ba6a5-7f04-4858-be84-d75964c74b34 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.060944 Nov 02 12:37:48.003224 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 446/912] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:37:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:48.288360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:48.289040 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:48.296298 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.296788 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.297252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.297956 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:48.298607 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:48.299014 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:48.454369 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:48.464262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-31427907-f111-44a2-8cc4-14495ffd11fd tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.182982 Nov 02 12:37:48.465340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 467/913] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:48 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:49.338916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785309596", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "131d0da7-02ff-497d-ba38-17a9c0dcd040"}], "security_groups": [{"name": "tempest-securitygroup--13620700"}], "key_name": "tempest-keypair-1625450988", "user_data": "}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:49.420210 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:49.447234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.network.neutron [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] validate_networks() for [('131d0da7-02ff-497d-ba38-17a9c0dcd040', None, None, None, None, None)] {{(pid=120740) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:37:49.490538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:49.491177 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.497912 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.498396 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.498836 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.499535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.499991 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.500414 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.642356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:49.650916 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-1a126733-02cf-452d-90f9-cc6fd74f80c6 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.164151 Nov 02 12:37:49.651741 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 468/914] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:49 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:49.838816 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:37:49.839229 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image limits 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:37:49.839720 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:37:49.840118 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image pref 0:0:0 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:37:49.840518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.virt.hardware [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120740) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:37:49.851078 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.851568 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.852003 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.852743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:49.853240 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:49.853837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:49.871029 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:37:49.875412 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:37:49.887641 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Going to run 1 instances... {{(pid=120740) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:37:49.890075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120740) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:37:49.948352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1de3ff8b-ef04-44da-8cf5-786e4a38629c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.615252 Nov 02 12:37:49.949565 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 447/915] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:37:49 2022] POST /compute/v2.1/servers => generated 400 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:37:49.962617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f6de8057-0808-4159-bc55-9d8993561fb9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:49.963229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f6de8057-0808-4159-bc55-9d8993561fb9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:49.965075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:50.030570 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f6de8057-0808-4159-bc55-9d8993561fb9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:50.038797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f6de8057-0808-4159-bc55-9d8993561fb9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1241 microversion: 2.1 time: 0.080706 Nov 02 12:37:50.039516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 469/916] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:49 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1241 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:50.675100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:50.676337 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:50.684912 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.685581 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.686230 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.687063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:50.687696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:50.688128 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:50.834307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:50.843715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a6391da9-dc28-4d0b-8b06-df784eae9aa1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.172744 Nov 02 12:37:50.844611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 448/917] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:50 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:51.061953 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:51.062565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:51.069127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.069504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.070634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.071340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.071796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.072213 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.136280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:51.143915 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-82886f97-3de5-467a-a537-b9a276d7c311 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1293 microversion: 2.1 time: 0.085881 Nov 02 12:37:51.144477 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 470/918] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:51 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:51.867800 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:51.868519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:51.875298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.875709 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.876140 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:51.876831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:51.877301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:51.877721 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.092596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:52.096071 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:52.103133 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-88594ccb-407e-45ed-8d6b-43c40fa63a6b tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.239080 Nov 02 12:37:52.103697 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 449/919] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:51 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:52.166500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:52.167081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:52.176258 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.177114 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.177789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.178727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.179392 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.180272 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.202179 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=100 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:52.344538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:52.352917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-b6c130ab-d5a0-48d0-b3b3-737bd2457398 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.190243 Nov 02 12:37:52.353558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 471/920] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:52 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:52.897286 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e61bbd-8342-4fc3-8cb4-12255bf84b03", "tag": "2231b107-814d-4ba2-ad77-6efaaff13dcc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:52.917255 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:52.918105 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:52.919981 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:52.933647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] Creating event network-changed:2231b107-814d-4ba2-ad77-6efaaff13dcc for instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 on hv-cinder-86327 Nov 02 12:37:52.939043 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-576979be-60f0-4201-bebe-193b46abbbcb req-01132f60-a0a8-41d1-910d-21e55b815ade service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045058 Nov 02 12:37:52.939805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 450/921] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:53.134964 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:53.135714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:53.148779 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.149299 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.149727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.150426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.150871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.151285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.293610 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.302510 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6633699c-bad2-4c6a-b831-3506f3370001 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.172406 Nov 02 12:37:53.310704 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 472/922] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:53 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:53.377380 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:53.378220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:53.385680 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.386258 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.386690 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.387621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:53.388141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:53.388632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:53.539160 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:53.547640 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d135dc10-f554-4f74-9b87-1867766a3629 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.175143 Nov 02 12:37:53.548311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 451/923] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:53 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:54.337277 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.338252 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:54.346427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.347020 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.347689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.348661 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.349255 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.349859 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.491235 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:54.499327 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c2f92b0a-4329-45dd-ac40-6566aa04cb37 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.168515 Nov 02 12:37:54.499897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 473/924] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:54 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:54.571968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:54.572557 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:54.579095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.579576 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.580220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.580921 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.581780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.582200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.718327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:54.726112 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-5188499d-1fb1-4e29-a679-b4c6c078c43a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.158922 Nov 02 12:37:54.726679 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 452/925] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:54 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:54.959435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16706f7a-636d-4b12-aa14-8a3c7a65622c", "name": "network-vif-plugged", "status": "completed", "tag": "83ebf17f-897d-4acb-afb7-aa488ae074e3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:54.970894 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:54.971381 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:54.971815 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:54.985236 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] Creating event network-vif-plugged:83ebf17f-897d-4acb-afb7-aa488ae074e3 for instance 16706f7a-636d-4b12-aa14-8a3c7a65622c on hv-cinder-86327 Nov 02 12:37:54.990614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bd4766b6-9a1f-458a-bc77-8afde327a1ba req-6ad043f0-653d-45af-8a21-f3f0a8e4c15e service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035241 Nov 02 12:37:54.991660 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 474/926] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:55.522696 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:55.523216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:55.529111 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.529590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.530023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.530702 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.531153 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.531574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.669966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:55.677714 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7a6000e2-8de9-40f9-9e14-764965d1115d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1267 microversion: 2.1 time: 0.158941 Nov 02 12:37:55.678273 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 453/927] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:55 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:55.749619 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:55.750314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:55.756918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.757435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.757868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.758556 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:55.759010 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:55.759432 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:55.895431 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:55.902949 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-08687c9a-b78e-421d-b42b-f4531a7679e1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.157779 Nov 02 12:37:55.903512 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 475/928] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:55 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:56.702178 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.702802 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.707084 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=91,nova_api:UPDATE=2,nova_api:INSERT=7 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:37:56.711958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.712452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.713126 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.713846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.714287 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.714827 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.868030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:56.881724 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-744c5137-5ff2-45e9-914d-7f942ea923e0 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1454 microversion: 2.1 time: 0.183741 Nov 02 12:37:56.882171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 454/929] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:56 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1454 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:37:56.904596 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.905356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.913362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.913856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.914301 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.915021 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.915468 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.915890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.926035 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:56.926882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:56.933661 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.934378 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.935013 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:56.935708 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:56.936312 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:56.936885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:57.077242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:57.086408 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6b11de45-e7ca-4cbd-bd66-d640eb025768 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1454 microversion: 2.1 time: 0.185570 Nov 02 12:37:57.087011 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 476/930] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:56 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1454 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:57.093076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:57.100908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-42b3c458-120a-4856-a704-3ed2d254aeda tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.178801 Nov 02 12:37:57.101504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 455/931] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:56 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:58.123286 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:58.123855 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:58.130320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.130805 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.131229 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.131917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.132356 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.132770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.267535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:58.275947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-bbb3367f-a869-49f3-90b2-42013061002c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.156862 Nov 02 12:37:58.276514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 477/932] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:58 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:37:58.971945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e61bbd-8342-4fc3-8cb4-12255bf84b03", "name": "network-vif-plugged", "status": "completed", "tag": "2231b107-814d-4ba2-ad77-6efaaff13dcc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:58.983773 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:58.984356 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:58.985152 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:58.997656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] Creating event network-vif-plugged:2231b107-814d-4ba2-ad77-6efaaff13dcc for instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 on hv-cinder-86327 Nov 02 12:37:59.002652 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-d4930d6f-2189-4ab9-b4fb-b19e03d41cdf req-ad334fa9-b3dc-4ebe-ba95-86eb7ed62967 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034835 Nov 02 12:37:59.003869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 456/933] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:59.099498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16706f7a-636d-4b12-aa14-8a3c7a65622c", "tag": "83ebf17f-897d-4acb-afb7-aa488ae074e3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:37:59.109909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.110688 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.111444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.123484 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] Creating event network-changed:83ebf17f-897d-4acb-afb7-aa488ae074e3 for instance 16706f7a-636d-4b12-aa14-8a3c7a65622c on hv-cinder-86327 Nov 02 12:37:59.129892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-7a5b2cf0-0c79-4e92-be23-91043c434011 req-c9ce49df-f294-4d10-8844-ce1b78dd2c1c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034763 Nov 02 12:37:59.130724 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 478/934] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:37:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:37:59.299149 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:37:59.299857 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:37:59.306447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.306940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.307610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.308331 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:37:59.308780 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:37:59.309403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:37:59.460676 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:37:59.469104 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7a43bb16-b087-404f-8c4f-2aff46b60fb2 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.173977 Nov 02 12:37:59.469680 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 457/935] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:37:59 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:00.490600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:00.496012 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:00.497047 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:00.504009 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.504504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.504932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.505658 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:00.506319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:00.506739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:00.639664 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:00.647280 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-49b35469-6725-4bdb-9ade-1e20955fa6ff tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1365 microversion: 2.1 time: 0.157722 Nov 02 12:38:00.647848 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 479/936] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:00 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:01.671015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.672725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:01.679101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:01.680558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=16 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:01.683383 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.683870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.684340 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.685090 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.685591 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.686023 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.817563 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:01.825172 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-d49e27ec-f2cb-4006-906b-4da795d28fde tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1555 microversion: 2.1 time: 0.158819 Nov 02 12:38:01.825742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 458/937] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:01.847133 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:01.847724 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:01.854575 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.855058 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.855493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.856195 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:01.856649 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:01.857110 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:01.937218 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-681e52da-f2e8-49f1-a81a-e6fcd18fd142 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.093935 Nov 02 12:38:01.937839 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 480/938] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:38:01 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-interface => generated 285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:02.891102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7e61bbd-8342-4fc3-8cb4-12255bf84b03", "tag": "2231b107-814d-4ba2-ad77-6efaaff13dcc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:02.900869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:02.901478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:02.901910 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:03.063600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] Creating event network-changed:2231b107-814d-4ba2-ad77-6efaaff13dcc for instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 on hv-cinder-86327 Nov 02 12:38:03.068375 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-cd6607eb-b245-4280-ac3d-ddbc949a9f7e req-c371dd00-9b03-421c-9311-cdd615c48b77 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180985 Nov 02 12:38:03.069169 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 459/939] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:32.433675 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:32.434411 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=46 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:32.439397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:32.440373 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:32.451416 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.451914 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.452350 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.453117 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:32.453595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:32.454026 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:32.480205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-338e977a-c374-40cd-a050-665817cbb9ea tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/ips" status: 200 len: 149 microversion: 2.1 time: 0.048155 Nov 02 12:38:32.480803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 481/940] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:38:32 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:33.849322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=10 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:33.850241 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=48 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:33.856115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d6ce16-7725-40ea-9430-1fb3484ec22d"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:33.858791 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:33.866460 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.866932 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.867367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:33.868063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:33.868517 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:33.868936 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:34.112886 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7a5bd90b-b427-4312-8cc1-801dddd15058 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265504 Nov 02 12:38:34.113631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 460/941] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:38:33 2022] POST /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:40.620532 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "26d6ce16-7725-40ea-9430-1fb3484ec22d"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:40.622869 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:40.629351 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.629827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.630262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.630942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.631390 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.631809 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.711398 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: POST /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments HTTP/1.1 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 74 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:38:40.713129 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {"volumeAttachment": {"volumeId": "26d6ce16-7725-40ea-9430-1fb3484ec22d"}} Nov 02 12:38:40.714941 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'server_id': 'f7e61bbd-8342-4fc3-8cb4-12255bf84b03', 'body': {'volumeAttachment': {'volumeId': '26d6ce16-7725-40ea-9430-1fb3484ec22d'}}} Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:38:40.716066 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:40.717641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 400 to user: Invalid volume: volume 26d6ce16-7725-40ea-9430-1fb3484ec22d is already attached to instances: f7e61bbd-8342-4fc3-8cb4-12255bf84b03 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c016cc11-d30b-4c01-8645-29cd21e3b881 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098290 Nov 02 12:38:40.719399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 482/942] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:38:40 2022] POST /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Nov 02 12:38:40.780398 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:40.781020 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:40.787613 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.788108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.788541 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.789261 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.789712 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.790138 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.871639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'services' on Instance uuid f7e61bbd-8342-4fc3-8cb4-12255bf84b03 {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:40.943113 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-26fe4e89-e56e-4aa3-8272-6398a9375dfe tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments/26d6ce16-7725-40ea-9430-1fb3484ec22d" status: 202 len: 0 microversion: 2.1 time: 0.166861 Nov 02 12:38:40.943861 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 461/943] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:38:40 2022] DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments/26d6ce16-7725-40ea-9430-1fb3484ec22d => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:40.952806 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:40.955069 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:40.961942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.962428 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.962847 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.963537 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:40.963983 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:40.964393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:40.996002 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-ddd759bd-9bcf-4bc9-81a3-63df505203b8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046747 Nov 02 12:38:40.996594 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 483/944] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:38:40 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:42.008400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.010741 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.017541 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.018016 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.018440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.019120 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.019561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.019975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.049274 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1b24581e-8c92-4195-aa9a-e2f954c34b72 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045155 Nov 02 12:38:42.049810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 462/945] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:38:42.111923 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.112464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.118391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.118868 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.119289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.119965 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.120672 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.121330 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.147496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:38:42.221698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-521979f4-d7cb-4321-90ec-f6cf9461c694 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 204 len: 0 microversion: 2.1 time: 0.113265 Nov 02 12:38:42.222278 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 484/946] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:38:42 2022] DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:38:42.231431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:42.232053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:42.238030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.238519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.238959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.239693 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:42.240156 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:42.240583 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:42.632095 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:42.639835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-bcf2a4d0-6f97-4ded-9749-8bdb1a745ec9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1679 microversion: 2.1 time: 0.412247 Nov 02 12:38:42.640395 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 463/947] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:42 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1679 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:43.664364 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:43.665127 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:43.671631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.672122 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.672558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.673304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:43.673767 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:43.674194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:43.812950 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:43.824635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-11ae43ba-3144-4163-a1b3-ebdce12dddab tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1679 microversion: 2.1 time: 0.164306 Nov 02 12:38:43.825816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 485/948] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:43 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1679 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:44.550556 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7e61bbd-8342-4fc3-8cb4-12255bf84b03", "name": "network-vif-deleted", "tag": "2231b107-814d-4ba2-ad77-6efaaff13dcc"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:44.561311 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.561796 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.562241 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.574718 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] Creating event network-vif-deleted:2231b107-814d-4ba2-ad77-6efaaff13dcc for instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 on hv-cinder-86327 Nov 02 12:38:44.582885 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-82511d7c-f8e6-41a6-9f03-18edd2188b85 req-c4e9db16-8ef4-4e20-996e-68ef908ba6af service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035923 Nov 02 12:38:44.584982 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 464/949] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:44.849053 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:44.849714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:44.856312 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.856871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.857393 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.858194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.858727 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.859226 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.891987 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:44.892388 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:44.892815 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:44.893287 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.objects.instance [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'fault' on Instance uuid f7e61bbd-8342-4fc3-8cb4-12255bf84b03 {{(pid=120739) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:38:44.934153 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:44.942319 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a24bc3a-4567-4519-8003-675dcee4ee3c tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 200 len: 1331 microversion: 2.1 time: 0.097383 Nov 02 12:38:44.942904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 486/950] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:44 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 1331 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:45.966348 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:45.967052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:45.973218 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.973700 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.974139 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.974832 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:45.975315 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:45.976233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:45.992108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 HTTP/1.1 Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:38:45.993656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:38:45.995507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f7e61bbd-8342-4fc3-8cb4-12255bf84b03'} Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:38:45.996662 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:38:45.998277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:38:45.999809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:38:45.999809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-18b293a8-3b04-45a2-b834-c54bc97ed5a9 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 404 len: 111 microversion: 2.1 time: 0.033366 Nov 02 12:38:45.999809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 465/951] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:45 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:38:46.004353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4a7bc3d0-435d-4cc8-a08e-fcb8a789ed28 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '.version_select at 0x7faf06846af0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:46.024337 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4a7bc3d0-435d-4cc8-a08e-fcb8a789ed28 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625450988" status: 202 len: 0 microversion: 2.1 time: 0.023749 Nov 02 12:38:46.024889 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 487/952] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Nov 2 12:38:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1625450988 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:38:46.650295 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6f81bf10-51ca-4ff5-bb16-c398c6a590b3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: .version_select at 0x7faf06994550>, body: {"keypair": {"name": "tempest-keypair-1480574635", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD9glvBsFtaXWqHmp95HLX23tTmqYqe78H5zvCdC9ZH8TkUqDVFY7skKVgyzw/i3RRS85PBqIhVi4c9S3iqM2AdD8z9UZqnH6QBo/y3lamAMvuMW/YA/zzjpsYz4307npg=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:46.665872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-6f81bf10-51ca-4ff5-bb16-c398c6a590b3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:46.669977 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-6f81bf10-51ca-4ff5-bb16-c398c6a590b3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:46.695007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6f81bf10-51ca-4ff5-bb16-c398c6a590b3 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048638 Nov 02 12:38:46.695746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 466/953] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:38:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:48.226407 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-460060124", "imageRef": "1432e0bc-c2cf-42c7-8853-2968183fde39", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "131d0da7-02ff-497d-ba38-17a9c0dcd040"}], "security_groups": [{"name": "tempest-securitygroup--1349618155"}], "key_name": "tempest-keypair-1480574635", "user_data": "}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:48.327234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] validate_networks() for [('131d0da7-02ff-497d-ba38-17a9c0dcd040', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:38:48.700096 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:38:48.700520 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:38:48.701042 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:38:48.701456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:38:48.701871 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:38:48.710816 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.711295 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.711738 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.712464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:48.712917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:48.713368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:48.730284 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:38:48.734465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Getting quotas for user a73941feee334ac294ac875001b148fb and project 3a32a1e0f4ae442398d6e179846e1e1b. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:38:48.746224 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:38:48.748504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1432e0bc-c2cf-42c7-8853-2968183fde39',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:38:48.796613 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-678cd570-4866-400b-8d55-689ff44eac12 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.575439 Nov 02 12:38:48.797492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 488/954] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:38:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:38:48.809372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-54c5ac41-5e9d-4754-a0f1-386c736fe5eb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:48.810138 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-54c5ac41-5e9d-4754-a0f1-386c736fe5eb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:48.866367 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-54c5ac41-5e9d-4754-a0f1-386c736fe5eb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:48.873890 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-54c5ac41-5e9d-4754-a0f1-386c736fe5eb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1241 microversion: 2.1 time: 0.069072 Nov 02 12:38:48.874289 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 467/955] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:48 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:49.898168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:49.898986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:49.905301 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.906078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.906722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.907205 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:49.907799 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:49.908253 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:49.992758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:50.000666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3d7a5aa3-588b-4498-af5b-78b2ce471348 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1299 microversion: 2.1 time: 0.107842 Nov 02 12:38:50.001500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 489/956] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:49 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:51.024809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:51.025478 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:51.032766 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.033284 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.033751 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.034444 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.034900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.035322 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.235827 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:51.243541 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-13492633-f55e-4fd2-ac57-df8e79cea30a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.223053 Nov 02 12:38:51.244108 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 468/957] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:51 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:51.277644 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2d59d3-68e8-4515-bac3-db001c47ccff", "tag": "f7c57a5d-b8ca-4734-925f-180cd5197250"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:51.290580 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:51.291317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:51.291746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:51.303496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] Creating event network-changed:f7c57a5d-b8ca-4734-925f-180cd5197250 for instance 6a2d59d3-68e8-4515-bac3-db001c47ccff on hv-cinder-86327 Nov 02 12:38:51.308890 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-31333e9f-eff9-47f4-b936-baf58062dd38 req-f61f46fd-d445-4267-b99f-8eb311f159fd service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036866 Nov 02 12:38:51.309531 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 490/958] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:38:52.267198 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:52.267799 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:52.274956 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.275436 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.275870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:52.276560 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:52.277034 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:52.277462 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:52.488691 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:52.496746 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-994aa219-b009-490e-832e-5fbf0c399864 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.233363 Nov 02 12:38:52.497458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 469/959] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:52 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:53.520325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:53.521033 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:53.528391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.528861 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.529314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.530006 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:53.530442 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:53.530853 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:53.682427 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:53.690263 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-034d9fbd-5b4c-4d54-b602-5e6516ac6e0e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.174030 Nov 02 12:38:53.690843 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 491/960] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:53 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:54.714110 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:54.714713 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:54.721338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.721769 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.722196 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.722908 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:54.723353 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:54.723782 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:54.871725 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:54.881288 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-37e2cc0e-32ce-4e1e-b90c-04edff0bb238 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.171530 Nov 02 12:38:54.882374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 470/961] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:54 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:55.904353 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:55.904908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:55.911340 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.911823 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.912264 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:55.912971 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:55.913456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:55.913885 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:56.044976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:56.052786 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d9475fca-e0f4-419b-9f74-8a1b67441476 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.152318 Nov 02 12:38:56.053899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 492/962] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:55 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.076417 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:57.077075 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:57.083549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.084053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.084500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.085233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.085682 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.086100 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.257384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:57.267527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-23ccd662-44fd-4850-9218-1ea9a224d424 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.195015 Nov 02 12:38:57.268107 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 471/963] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:57 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:57.274926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2d59d3-68e8-4515-bac3-db001c47ccff", "name": "network-vif-plugged", "status": "completed", "tag": "f7c57a5d-b8ca-4734-925f-180cd5197250"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:38:57.291706 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:57.292206 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:57.292636 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:57.305669 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] Creating event network-vif-plugged:f7c57a5d-b8ca-4734-925f-180cd5197250 for instance 6a2d59d3-68e8-4515-bac3-db001c47ccff on hv-cinder-86327 Nov 02 12:38:57.310557 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-51324d56-7c8e-4fda-b0d4-264a9d93f7c1 req-eae9291d-b980-4bf0-a31b-afcafd218c50 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039591 Nov 02 12:38:57.311380 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 493/964] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:38:58.292102 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:58.292788 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:58.299836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.300326 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.300767 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.301508 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:58.301969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:58.302400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:58.437294 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:58.446329 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-95e9c0ec-d5db-4ba5-87e3-f9dc661fae21 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1367 microversion: 2.1 time: 0.158734 Nov 02 12:38:58.446910 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 472/965] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:58 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:38:59.470708 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.471409 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.473799 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:59.474457 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:59.480607 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.481121 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.481558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.482254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.482942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.483108 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.614600 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:38:59.623517 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-34cb6c9e-8c54-4ba1-a59d-9d36ffef86ce tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1556 microversion: 2.1 time: 0.156956 Nov 02 12:38:59.624097 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 494/966] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1556 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:38:59.646524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:38:59.647087 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:38:59.648981 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:38:59.654591 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.655079 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.655511 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.656200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:38:59.656651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:38:59.657099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:38:59.738611 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-b1f8620c-d431-4b3b-a270-1cc0e2549a5a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095874 Nov 02 12:38:59.739251 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 473/967] 10.222.0.85 () {58 vars in 1275 bytes} [Wed Nov 2 12:38:59 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:00.953389 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2d59d3-68e8-4515-bac3-db001c47ccff", "tag": "f7c57a5d-b8ca-4734-925f-180cd5197250"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:00.963771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:00.964250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:00.964676 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:00.975742 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] Creating event network-changed:f7c57a5d-b8ca-4734-925f-180cd5197250 for instance 6a2d59d3-68e8-4515-bac3-db001c47ccff on hv-cinder-86327 Nov 02 12:39:00.980707 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-bfb48023-403d-40e5-8571-bc591b9039b8 req-ce00065f-8439-4e63-b79d-2839632e2b7b service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031048 Nov 02 12:39:00.981419 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 495/968] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:34.911494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:34.912216 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:34.917057 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:34.917554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:34.926892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.927926 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.928364 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.929101 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:34.929555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:34.930119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:34.958307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-f1c12cf6-2f01-4bef-9bbe-4bfc0eda2d87 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/ips" status: 200 len: 149 microversion: 2.1 time: 0.048836 Nov 02 12:39:34.958878 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 474/969] 10.222.0.85 () {58 vars in 1248 bytes} [Wed Nov 2 12:39:34 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/ips => generated 149 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:36.296167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:36.296917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:39:36.302285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a71f4e3b-2590-4062-9f98-215bbf7aecd8"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:36.304714 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:36.315323 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.315817 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.316259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.317079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:36.317480 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:36.317906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:36.725461 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-0c8b26f5-584b-4d3e-acd5-d93a5625f5c1 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "POST /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430599 Nov 02 12:39:36.726078 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 496/970] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:39:36 2022] POST /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:39:43.338962 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:43.339617 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:43.345839 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.346316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.346743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.347415 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.347859 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.348892 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.483464 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lazy-loading 'services' on Instance uuid 6a2d59d3-68e8-4515-bac3-db001c47ccff {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:39:43.556507 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a4581dd6-d756-47f3-ab53-fec0d3a6b489 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments/a71f4e3b-2590-4062-9f98-215bbf7aecd8" status: 202 len: 0 microversion: 2.1 time: 0.221232 Nov 02 12:39:43.557119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 475/971] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:39:43 2022] DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments/a71f4e3b-2590-4062-9f98-215bbf7aecd8 => generated 0 bytes in 223 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:39:43.566004 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:43.568622 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:43.575506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.575986 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.576455 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.577313 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:43.577764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:43.578186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:43.611689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dacdf192-9597-4b24-9529-3a438e57e803 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049861 Nov 02 12:39:43.612249 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 497/972] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:39:43 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:44.626232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.628555 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.634904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.635390 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.635829 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.636525 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.636976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.637424 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.668211 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-528555e9-bf39-4d80-b9e1-5da9117c0dfa tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047129 Nov 02 12:39:44.668783 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 476/973] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:39:44.733698 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.734230 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.741640 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.742109 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.742536 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.743214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.743656 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.744072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.773245 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:39:44.851851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-079041e4-c5b9-4495-8d21-d88b9504c830 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 204 len: 0 microversion: 2.1 time: 0.121616 Nov 02 12:39:44.853060 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 498/974] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:44 2022] DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:39:44.861798 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:44.862422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:44.869594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.870082 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.870519 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:44.871215 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:44.871674 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:44.872099 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:45.008600 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:45.016328 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-45ff052c-bc52-4065-908e-950441934773 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1681 microversion: 2.1 time: 0.158394 Nov 02 12:39:45.016893 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 477/975] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:44 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:46.041711 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:46.042433 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:46.048769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.049279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.049710 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.050399 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:46.050851 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:46.051302 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:46.182496 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:46.190550 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-13e57908-1789-4cb7-ad09-9e3d6b038671 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1681 microversion: 2.1 time: 0.153088 Nov 02 12:39:46.191143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 499/976] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:46 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:39:47.214736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:47.215500 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:47.217316 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2d59d3-68e8-4515-bac3-db001c47ccff", "name": "network-vif-deleted", "tag": "f7c57a5d-b8ca-4734-925f-180cd5197250"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:39:47.224259 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.224751 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.225387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.226519 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.227361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.227942 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.274374 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:47.274920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:47.279531 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:47.299877 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] Creating event network-vif-deleted:f7c57a5d-b8ca-4734-925f-180cd5197250 for instance 6a2d59d3-68e8-4515-bac3-db001c47ccff on hv-cinder-86327 Nov 02 12:39:47.304424 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a73941feee334ac294ac875001b148fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a32a1e0f4ae442398d6e179846e1e1b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:39:47.305125 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c2df7537-41da-40d7-8aa9-a4dc27403ef9 req-dfe80fbf-5418-4011-ae57-ebe3fce97251 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099188 Nov 02 12:39:47.306968 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 478/977] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:39:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:39:47.319960 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e0c53591-60de-42f0-940a-31943213f56a tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 200 len: 1613 microversion: 2.1 time: 0.108827 Nov 02 12:39:47.321997 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 500/978] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:47 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:39:48.344299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.345063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:48.352352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.352831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.353308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.354001 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:48.354455 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:48.354882 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:48.368772 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff HTTP/1.1 Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:39:48.370727 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:48.372399 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '6a2d59d3-68e8-4515-bac3-db001c47ccff'} Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:48.373301 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:48.374872 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:48.376610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:48.376610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-72ad2ebe-1052-4f69-9420-a0fa26b9febc tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 404 len: 111 microversion: 2.1 time: 0.032073 Nov 02 12:39:48.376610 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 479/979] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:48 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:48.381028 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-efeef56e-b129-45b1-b55f-a245f5a6f05f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '.version_select at 0x7faf068e09d0>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:48.400483 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-efeef56e-b129-45b1-b55f-a245f5a6f05f tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480574635" status: 202 len: 0 microversion: 2.1 time: 0.023137 Nov 02 12:39:48.400990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 501/980] 10.222.0.85 () {58 vars in 1221 bytes} [Wed Nov 2 12:39:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1480574635 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:39:50.149777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.150276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.156724 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.157239 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.157701 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.158416 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.158862 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.159277 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.173414 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff HTTP/1.1 Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:39:50.174942 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.176715 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '6a2d59d3-68e8-4515-bac3-db001c47ccff'} Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:50.177817 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.179377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.181041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:50.181041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-850cbe87-746d-4e46-a3b8-c3da8adaaa90 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 404 len: 111 microversion: 2.1 time: 0.030410 Nov 02 12:39:50.181041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 480/981] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:50 2022] DELETE /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:50.185314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:50.185929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 6a2d59d3-68e8-4515-bac3-db001c47ccff] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:50.192883 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.193397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.194176 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.194758 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:50.195276 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:50.195708 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:50.210471 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff HTTP/1.1 Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:39:50.212089 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.213746 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '6a2d59d3-68e8-4515-bac3-db001c47ccff'} Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:50.214814 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. Nov 02 12:39:50.216083 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:50.217234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 6a2d59d3-68e8-4515-bac3-db001c47ccff could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:50.217234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7d08e549-4e35-45c5-a902-59471d8c2043 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff" status: 404 len: 111 microversion: 2.1 time: 0.032643 Nov 02 12:39:50.217234 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 502/982] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:50 2022] GET /compute/v2.1/servers/6a2d59d3-68e8-4515-bac3-db001c47ccff => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:39:51.358119 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.358629 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.365639 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.366115 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.366547 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.367234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.367683 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.368103 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.381632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 HTTP/1.1 Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:39:51.383180 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.384790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f7e61bbd-8342-4fc3-8cb4-12255bf84b03'} Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:51.385963 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.387429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.389296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:51.389296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-31774140-3556-4477-a621-ed87cdddf6a8 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 404 len: 111 microversion: 2.1 time: 0.030362 Nov 02 12:39:51.389296 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 481/983] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:51 2022] DELETE /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:51.392907 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.393572 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f7e61bbd-8342-4fc3-8cb4-12255bf84b03] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.400018 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.400490 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.400918 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.401690 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.402079 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.402508 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.416166 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 HTTP/1.1 Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:39:51.417689 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.419365 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'f7e61bbd-8342-4fc3-8cb4-12255bf84b03'} Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:51.420444 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. Nov 02 12:39:51.422056 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.423888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f7e61bbd-8342-4fc3-8cb4-12255bf84b03 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:51.423888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4f20f100-a331-49e0-8b6b-53a5e8600330 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03" status: 404 len: 111 microversion: 2.1 time: 0.030005 Nov 02 12:39:51.423888 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 503/984] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:51 2022] GET /compute/v2.1/servers/f7e61bbd-8342-4fc3-8cb4-12255bf84b03 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:39:51.428002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.428490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.434400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.434874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.435304 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.435988 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.436430 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.436846 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.450276 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb HTTP/1.1 Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:39:51.451801 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.454586 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '4e034cdd-9d61-4dd9-9a05-f17b722a9fdb'} Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:51.455843 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.458214 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.460384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:51.460384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-4b744cb5-052e-4bbe-92ef-6991c46b5b9e tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 404 len: 111 microversion: 2.1 time: 0.029549 Nov 02 12:39:51.460384 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 482/985] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:51 2022] DELETE /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:51.461766 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:51.462402 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:51.468314 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.468792 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.469248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.469967 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:51.470410 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:51.471333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:51.484692 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb HTTP/1.1 Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:39:51.486237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.487906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': '4e034cdd-9d61-4dd9-9a05-f17b722a9fdb'} Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:51.489651 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. Nov 02 12:39:51.491254 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:51.492709 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance 4e034cdd-9d61-4dd9-9a05-f17b722a9fdb could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:51.492709 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-7acfa26d-049f-4ff9-9a22-ef29c84e4149 tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb" status: 404 len: 111 microversion: 2.1 time: 0.029739 Nov 02 12:39:51.492709 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 504/986] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:51 2022] GET /compute/v2.1/servers/4e034cdd-9d61-4dd9-9a05-f17b722a9fdb => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Nov 02 12:39:52.634804 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.635360 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.641821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.642303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.642743 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.643445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.643900 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.644320 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.659765 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 HTTP/1.1 Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:39:52.661338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.662958 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': 'f2df250e-1726-4f54-a16d-759cf7372159'} Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:52.663937 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.665588 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.667157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:52.667157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e997caeb-657f-44ce-b615-3adde5b00f2d tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 404 len: 111 microversion: 2.1 time: 0.031844 Nov 02 12:39:52.667157 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 483/987] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:39:52 2022] DELETE /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:39:52.672304 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:39:52.672905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] [instance: f2df250e-1726-4f54-a16d-759cf7372159] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:39:52.679498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.680036 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.680485 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.681144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:39:52.681595 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:39:52.682016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:39:52.696702 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] HTTP exception thrown: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Request method failure captured: Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 HTTP/1.1 Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmQL7-60KvTy4i3R2_XWU0Kfhfd9bK4F2rdMfOCnIAdcXRHRmUmmyDGhLbXueWgPrGMP-AGMJ7BWwAstZtOm8DZS4bD1lnAIuJIZKAHREqLge-yp5O1lKy34ZHcbGb2XUT2p66UkaP8Z8YX9AYI-wvI595p8O9MFO80-aRxaMdAPSQg Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:39:52.698320 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/3a32a1e0f4ae442398d6e179846e1e1b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: 3a32a1e0f4ae442398d6e179846e1e1b Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1725355312 Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: a73941feee334ac294ac875001b148fb Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-AttachVolumeNegativeTest-1725355312-project Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.699929 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'f2df250e-1726-4f54-a16d-759cf7372159'} Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:39:52.700721 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. Nov 02 12:39:52.702124 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:39:52.703546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] Returning 404 to user: Instance f2df250e-1726-4f54-a16d-759cf7372159 could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:39:52.703546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-72d59a02-6fe3-4765-bb02-1fe5b15c60cb tempest-AttachVolumeNegativeTest-1725355312 tempest-AttachVolumeNegativeTest-1725355312-project] 10.222.0.85 "GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159" status: 404 len: 111 microversion: 2.1 time: 0.031181 Nov 02 12:39:52.703546 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 505/988] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:39:52 2022] GET /compute/v2.1/servers/f2df250e-1726-4f54-a16d-759cf7372159 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:26.814254 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-0af7ebd5-03af-4abe-96ba-337608e1b7c6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'create', calling method: .version_select at 0x7faf068cfd30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1535183324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrJpKD5trS7Sda1pnUs2m6gWtjjygAiAbEWM+Ol9468cDt+I7E4XI9sG9EVjz9r2BI00H7LQ6vUfNW50v6HhH4JgyJtFpoHtbcqImkJ7qVXYSXU3sF74H7lCkuVh3fD/Q=="}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:26.820458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=20 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:26.821143 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:26.822567 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:41:26.822724 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Wed Nov 2 12:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.85) !!! Nov 02 12:41:26.852155 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-0af7ebd5-03af-4abe-96ba-337608e1b7c6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Getting quotas for project fc45d759676e41178c93f56305f41958. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:26.856053 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.quota [None req-0af7ebd5-03af-4abe-96ba-337608e1b7c6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Getting quotas for user 88eb3c1d9e63402b8d045bc2f9e4d91a and project fc45d759676e41178c93f56305f41958. Resources: {'key_pairs'} {{(pid=120740) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:26.883487 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-0af7ebd5-03af-4abe-96ba-337608e1b7c6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.073655 Nov 02 12:41:26.884011 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 484/989] 10.222.0.85 () {60 vars in 1159 bytes} [Wed Nov 2 12:41:26 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:26.934982 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:26.935723 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:26.937145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:41:26.937310 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Wed Nov 2 12:41:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.85) !!! Nov 02 12:41:26.942122 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-849894092", "imageRef": "aed3f600-b3b6-4692-bd42-deeb0f830a06", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1535183324", "networks": [{"uuid": "f3195229-1c26-41c0-ae8b-17364debbf8d"}]}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:26.998904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.network.neutron [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] validate_networks() for [('f3195229-1c26-41c0-ae8b-17364debbf8d', None, None, None, None, None)] {{(pid=120739) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Nov 02 12:41:27.477437 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Flavor limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Nov 02 12:41:27.477863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Image limits 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Nov 02 12:41:27.478328 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Flavor pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Nov 02 12:41:27.478736 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Image pref 0:0:0 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Nov 02 12:41:27.479177 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.virt.hardware [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120739) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Nov 02 12:41:27.488782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.489290 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.489722 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.490456 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:27.490905 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:27.491323 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:27.508480 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Getting quotas for project fc45d759676e41178c93f56305f41958. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:393}} Nov 02 12:41:27.512635 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.quota [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Getting quotas for user 88eb3c1d9e63402b8d045bc2f9e4d91a and project fc45d759676e41178c93f56305f41958. Resources: {'ram', 'instances', 'cores'} {{(pid=120739) _get_quotas /opt/stack/nova/nova/quota.py:383}} Nov 02 12:41:27.524795 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Going to run 1 instances... {{(pid=120739) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Nov 02 12:41:27.527084 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='aed3f600-b3b6-4692-bd42-deeb0f830a06',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120739) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Nov 02 12:41:27.579360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-48037b04-42e5-4542-ae78-d83e326b9b06 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646172 Nov 02 12:41:27.580238 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 506/990] 10.222.0.85 () {60 vars in 1147 bytes} [Wed Nov 2 12:41:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Nov 02 12:41:27.591524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-91869850-a76d-4888-8bf3-f136375bb223 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:27.592805 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-91869850-a76d-4888-8bf3-f136375bb223 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:27.656533 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-91869850-a76d-4888-8bf3-f136375bb223 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:27.666295 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-91869850-a76d-4888-8bf3-f136375bb223 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1258 microversion: 2.1 time: 0.078820 Nov 02 12:41:27.666865 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 485/991] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:27 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:28.689863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:28.690503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:28.700605 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.701241 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.701669 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.702545 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:28.703037 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:28.703540 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:28.772757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:28.781424 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e7b9d1db-b0e4-47d3-9315-565e2a5cd7f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1310 microversion: 2.1 time: 0.095402 Nov 02 12:41:28.782222 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 507/992] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:28 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1310 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:29.805312 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:29.805930 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:29.813719 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.814207 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.814647 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:29.815363 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:29.815810 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:29.816749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:30.020362 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:30.031005 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e6ad0577-65e7-48e4-83a7-4f51bdef6606 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.229502 Nov 02 12:41:30.031860 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 486/993] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:29 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:31.059666 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:31.060297 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:31.068967 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.069498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.069940 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.070662 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:31.071125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:31.071680 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:31.237042 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:31.245770 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-5ee7b7c4-fa19-4b2d-9bdd-3a3928a1519a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.194225 Nov 02 12:41:31.246361 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 508/994] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:31 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:32.269732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:32.270323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:32.276975 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.277490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.277924 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.278630 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.279105 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.279524 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.452609 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:32.455939 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:32.463530 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.464118 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.464739 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.465872 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:32.466569 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:32.467214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:32.483081 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:32.494874 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7cb8c947-9ee0-4527-a9b6-fc3137d735bf tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.229302 Nov 02 12:41:32.496307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 487/995] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:32 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:33.533618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:33.534380 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:33.541527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.542019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.542452 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:33.543168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:33.543620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:33.544041 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:33.714213 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:33.727352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-39c7bb63-4bb6-4117-a7ec-145d5e90b22c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.197297 Nov 02 12:41:33.728248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 488/996] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:33 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:34.759109 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:34.761864 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:34.774929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.775833 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.776504 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.778016 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:34.778956 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:34.779774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:34.968327 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:34.978518 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-da52099f-af27-40f1-9b1e-22b2316e8867 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.226835 Nov 02 12:41:34.979427 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 489/997] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:34 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:36.004012 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:36.004771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:36.011757 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.012199 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.012584 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.013344 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:36.013808 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:36.014237 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:36.197587 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:36.211195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1df11991-14d3-4443-952d-5ce3a1836be8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.212065 Nov 02 12:41:36.212039 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 490/998] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:35 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:37.017631 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-70b213dd-481a-400d-b4c5-f7fe4f245c0d tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "POST /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c/action" status: 200 len: 14 microversion: 2.1 time: 4.570543 Nov 02 12:41:37.018611 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 509/999] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:41:32 2022] POST /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c/action => generated 14 bytes in 4572 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Nov 02 12:41:37.235815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:37.236710 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:37.246836 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.247410 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.247851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.248589 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:37.249076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:37.249505 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:37.662742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=6 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:37.680651 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:37.690047 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-42790a5d-e2bb-4405-bb9b-88290389c2f8 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.458728 Nov 02 12:41:37.690749 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 491/1000] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:37 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:38.727597 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:38.728426 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:38.731150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=2 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.731963 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell0:SELECT=6 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:38.738897 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.740054 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.740507 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.741285 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:38.741753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:38.742435 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:38.941913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:38.951217 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-e4eb9f72-ae35-4d56-a2ac-c4d7ea393636 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.227293 Nov 02 12:41:38.952334 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 510/1001] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:38 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:39.137423 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:39.149332 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.150060 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.150503 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.162826 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] Creating event network-changed:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:41:39.170385 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-e7726855-b0c6-4e3e-a622-87156337ec29 req-6d2550db-b11e-4217-8d70-01954aadcc1a service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.239665 Nov 02 12:41:39.170983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 492/1002] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:39.320951 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.321506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:39.329740 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.330541 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.332745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.332745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.333246 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.333678 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.361315 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Going to try to terminate instance {{(pid=120739) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:41:39.464856 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-4607b8fc-311d-40c3-b14d-11f5ad0a6cf1 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "DELETE /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 204 len: 0 microversion: 2.1 time: 0.147440 Nov 02 12:41:39.465782 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 511/1003] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:41:39 2022] DELETE /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:41:39.477961 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.478775 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:39.485748 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.486323 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.487920 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.488729 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:39.490072 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:39.490591 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:39.642959 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:39.651809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-aa509570-2972-4bc3-8da7-ebe93401faee tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1578 microversion: 2.1 time: 0.181468 Nov 02 12:41:39.652394 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 493/1004] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1578 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:39.992362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:39.993671 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:40.004534 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.005345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.005970 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.007053 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.007744 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.008412 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.186771 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:40.195063 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-2f8e4a32-b8de-423c-a8d0-9ab9e3abbd5c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.210466 Nov 02 12:41:40.195683 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 512/1005] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:39 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:40.676491 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:40.677400 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:40.683983 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.684569 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.684954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.685756 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:40.686222 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:40.686666 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:40.830448 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:40.838976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6e62da1e-cf98-40ed-ac89-dba7c5941fa9 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1578 microversion: 2.1 time: 0.166935 Nov 02 12:41:40.839561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 494/1006] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:40 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1578 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:41.192369 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16706f7a-636d-4b12-aa14-8a3c7a65622c", "tag": "83ebf17f-897d-4acb-afb7-aa488ae074e3"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:41.209588 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.210208 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.210789 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.222019 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:41.223061 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:41.230908 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] Creating event network-changed:83ebf17f-897d-4acb-afb7-aa488ae074e3 for instance 16706f7a-636d-4b12-aa14-8a3c7a65622c on hv-cinder-86327 Nov 02 12:41:41.232693 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.233668 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.234370 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.235545 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.236289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-ddcebc2e-1acd-4c07-a0d9-84c2a0e4cc9b req-6fd40280-b825-421c-ba7c-22f691ae41e0 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050597 Nov 02 12:41:41.236429 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.237476 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 513/1007] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:41.237619 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.465123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:41.474483 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e0070a0b-559f-42dd-b779-917784939e2d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.258876 Nov 02 12:41:41.475318 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 495/1008] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:41 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:41.867796 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:41.868794 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:41.876440 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.877279 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.878451 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:41.879345 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:41.879973 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:41.880574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.316524 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ff4810b8d4ef4c80a47b3208ce5439d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b3b8f23a66e4540a0f65330c6d6496e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:42.334697 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-dce14170-238b-4099-9731-444ccad7c2c5 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 200 len: 1578 microversion: 2.1 time: 0.473219 Nov 02 12:41:42.345800 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 514/1009] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:41 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 1578 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:42.511835 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:42.512518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:42.519022 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.519514 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.520025 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.520944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.521620 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.522214 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.662656 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16706f7a-636d-4b12-aa14-8a3c7a65622c", "name": "network-vif-deleted", "tag": "83ebf17f-897d-4acb-afb7-aa488ae074e3"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:42.689905 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:42.691234 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:42.691840 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:42.706870 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] Creating event network-vif-deleted:83ebf17f-897d-4acb-afb7-aa488ae074e3 for instance 16706f7a-636d-4b12-aa14-8a3c7a65622c on hv-cinder-86327 Nov 02 12:41:42.712815 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-9eb48dc6-1754-413d-bb1f-2e56ac36cc82 req-dd00c58e-bffc-49a4-9bdf-a56904c3e995 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.206558 Nov 02 12:41:42.713763 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 496/1010] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:42.725492 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:42.733568 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-724e59be-5c12-4d69-976d-e67395a6b619 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.225662 Nov 02 12:41:42.734149 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 515/1011] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:42 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:43.366447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.367793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] [instance: 16706f7a-636d-4b12-aa14-8a3c7a65622c] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:43.375819 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.376326 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.376771 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.377570 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.378527 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.378954 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.393471 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.wsgi [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] HTTP exception thrown: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Request method failure captured: Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: request: GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c HTTP/1.1 Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept: application/json Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Accept-Encoding: identity Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Connection: close Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Length: 0 Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Content-Type: application/json Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Host: 10.222.0.85 Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Openstack-System-Scope: None Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: User-Agent: python-urllib3/1.26.12 Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Auth-Token: gAAAAABjYmR53UFIDjeFLRfIyZ0mMAQwaehSfPmucze7OTX1u85FLhGK5ou5jb3of04A_XbjXLrt3yZGXLpt_dBb_d2-ksLRVXbhmhQr_J7I9ZT6m0eR8V6oNn9hv_X0DLFtEsGN54NFJfZgAw5a-0nr2_Mp1DiKU_BL4zKn022QQ6gD47fQPRE Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Id: None Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Domain-Name: None Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Identity-Status: Confirmed Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Is-Admin-Project: True Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Id: default Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Domain-Name: Default Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Id: 2b3b8f23a66e4540a0f65330c6d6496e Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Project-Name: tempest-TestVolumeBootPattern-328779661 Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Role: member,reader Nov 02 12:41:43.395752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Roles: member,reader Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_2b3b8f23a66e4540a0f65330c6d6496e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/2b3b8f23a66e4540a0f65330c6d6496e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b3b8f23a66e4540a0f65330c6d6496e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/2b3b8f23a66e4540a0f65330c6d6496e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant: tempest-TestVolumeBootPattern-328779661 Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Id: 2b3b8f23a66e4540a0f65330c6d6496e Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-Tenant-Name: tempest-TestVolumeBootPattern-328779661 Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User: tempest-TestVolumeBootPattern-328779661-project Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Id: default Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Domain-Name: Default Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Id: ff4810b8d4ef4c80a47b3208ce5439d5 Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: X-User-Name: tempest-TestVolumeBootPattern-328779661-project Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: method: > Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: exception: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. Nov 02 12:41:43.398672 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: action_args: {'id': '16706f7a-636d-4b12-aa14-8a3c7a65622c'} Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:41:43.400422 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. Nov 02 12:41:43.403352 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: ERROR nova.api.openstack.wsgi Nov 02 12:41:43.405677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Returning 404 to user: Instance 16706f7a-636d-4b12-aa14-8a3c7a65622c could not be found. {{(pid=120740) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:41:43.405677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-acb81a58-3757-480f-b54f-50b356d52405 tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c" status: 404 len: 111 microversion: 2.1 time: 0.038210 Nov 02 12:41:43.405677 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 497/1012] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:43 2022] GET /compute/v2.1/servers/16706f7a-636d-4b12-aa14-8a3c7a65622c => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:41:43.758077 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:43.758663 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:43.765346 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.766012 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.766538 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.767332 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:43.767874 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:43.768387 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:43.907333 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:43.915695 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a97ddbf-53e5-419e-81ab-463f98e2bb05 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.161553 Nov 02 12:41:43.916298 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 516/1013] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:43 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:44.728142 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-6d630d79-0831-4550-a1b1-f46e86504fca tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] Calling method '.version_select at 0x7faf068cf8b0>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.771869 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-6d630d79-0831-4550-a1b1-f46e86504fca tempest-TestVolumeBootPattern-328779661 tempest-TestVolumeBootPattern-328779661-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1055812514" status: 202 len: 0 microversion: 2.1 time: 0.047217 Nov 02 12:41:44.772624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 498/1014] 10.222.0.85 () {58 vars in 1263 bytes} [Wed Nov 2 12:41:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1055812514 => generated 0 bytes in 49 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:41:44.942375 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:44.943323 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:44.949945 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.950429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.950892 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:44.951566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:44.952017 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:44.952439 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:45.105187 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:45.115562 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-855e174a-416e-48d0-8afa-28c142e4dd4c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.179597 Nov 02 12:41:45.116170 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 517/1015] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:44 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:46.143396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:46.144170 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:46.153558 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.154319 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.154923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.155825 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.168107 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.168554 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.286117 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "name": "network-vif-plugged", "status": "completed", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:46.296506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:46.296988 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:46.297449 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:46.309682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] Creating event network-vif-plugged:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:41:46.314978 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-5c0862b8-1404-4513-9570-5e558c54cf97 req-6829fc5e-9806-4a72-a939-137d212bc354 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157360 Nov 02 12:41:46.316497 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 518/1016] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:46.415171 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:46.432737 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8a6bc7cb-28f3-4378-9b82-22d1ebe1c1d5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.296936 Nov 02 12:41:46.433496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 499/1017] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:46 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:47.458461 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:47.459171 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:47.466094 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.466876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.467611 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.468339 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:47.468793 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:47.469248 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:47.626429 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:47.635150 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-546c62a1-527b-4742-8a9c-6d03cc231ff9 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1358 microversion: 2.1 time: 0.181502 Nov 02 12:41:47.635728 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 519/1018] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:47 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:48.661856 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:48.662618 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:48.669440 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.669929 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.670379 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.671083 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.671532 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.671950 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.906835 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:48.916026 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-7d92ff30-c72f-4194-a9d5-d99eb01062a3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1548 microversion: 2.1 time: 0.259952 Nov 02 12:41:48.916776 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 500/1019] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:48 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1548 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:48.939498 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:48.940154 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:48.947120 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.947687 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.948842 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:48.949658 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:48.950275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:48.950757 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.088374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:49.096976 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-f14a192e-0ac0-41c6-a85c-498aa04d6431 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1548 microversion: 2.1 time: 0.160908 Nov 02 12:41:49.097583 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 520/1020] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:48 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1548 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:41:49.119010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:49.124063 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:49.124837 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Searching by: {'deleted': False, 'project_id': 'fc45d759676e41178c93f56305f41958'} {{(pid=120740) get_all /opt/stack/nova/nova/compute/api.py:3017}} Nov 02 12:41:49.131658 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.132141 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.132577 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.133338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.133790 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.134243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.233813 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.multi_cell_list [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120740) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Nov 02 12:41:49.345675 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-78f49184-2c1f-4889-b654-f4ed17121f25 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.230698 Nov 02 12:41:49.346490 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 501/1021] 10.222.0.85 () {58 vars in 1125 bytes} [Wed Nov 2 12:41:49 2022] GET /compute/v2.1/servers => generated 342 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:49.358266 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:49.358946 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:49.369523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.369523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.369523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.369523 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:49.369903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:49.369903 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:49.521464 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:49.529737 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d51e61d0-a140-4bed-961c-1ee93d035d15 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1548 microversion: 2.1 time: 0.175531 Nov 02 12:41:49.530242 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 521/1022] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:49 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:41:51.171522 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "20ad8711-91c4-44ff-97a2-139605d948d0"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:41:51.175777 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:51.187220 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.188002 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.188807 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.190626 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:51.191459 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:51.192194 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:51.624535 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-a2bbef04-f4ce-439f-9a07-566d84336db3 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.460030 Nov 02 12:41:51.625742 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 502/1023] 10.222.0.85 () {60 vars in 1323 bytes} [Wed Nov 2 12:41:51 2022] POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments => generated 194 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:41:58.302414 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:41:58.303024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:41:58.305630 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:58.311016 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:58.311503 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:58.311930 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:58.312657 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:41:58.313145 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:41:58.313565 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:41:58.317289 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:41:58.449678 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:41:58.458535 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-12c08629-2fde-425a-8906-dac3cd59574d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1594 microversion: 2.1 time: 0.159976 Nov 02 12:41:58.459093 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 522/1024] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:41:58 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1594 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:00.572131 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:00.581066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell0:SELECT=2 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:00.581066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:00.589342 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:00.589896 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:00.590566 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:00.595445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:00.609469 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.compute.server_external_events [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] Creating event network-changed:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:42:00.616403 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [req-c8fc5f07-0c48-4a24-99ed-361a6ef62e12 req-06c2ed87-4c15-4277-a8d4-e2d93b9611ef service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047623 Nov 02 12:42:00.617649 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 503/1025] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:01.725560 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1390247077"}} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:01.726098 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:01.735909 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.737042 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.737465 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.738749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:01.738749 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:01.739076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:01.868554 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.network.security_group_api [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Adding security group 1018f7de-3970-4e76-aa57-ce041733c74a to port 958295e8-1c3b-4281-9b06-162fe002d30e Nov 02 12:42:02.178220 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-8d79ac94-84a4-4e21-9d43-fae7a40b1c44 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.457522 Nov 02 12:42:02.178829 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 523/1026] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:01 2022] POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:02.187467 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:02.188168 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:02.196631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.197159 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.197594 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.198308 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.199923 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.200774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.351986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:02.360425 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-24f99e05-3eee-4493-ac6a-f4b0e0c8c5c5 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1760 microversion: 2.1 time: 0.177090 Nov 02 12:42:02.361022 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 504/1027] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:02 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1760 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:42:02.632161 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:02.642063 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:02.642980 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:02.643412 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:02.655042 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] Creating event network-changed:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:42:02.661180 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d82bb6a9-b737-4533-81f9-6caa8e81a233 req-83104579-6c3f-4d63-966e-1cc06c1a4193 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032946 Nov 02 12:42:02.662168 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 524/1028] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:42:19.380248 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:42:19.382454 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:19.385243 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=3 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.385904 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=7 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.391784 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.392278 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.392707 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.393445 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.394318 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.394318 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.468880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-acb7934b-6d31-4329-bfd0-7a638c0423f4 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.092240 Nov 02 12:42:19.469479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 505/1029] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:42:19 2022] POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:42:19.478989 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:19.479691 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:19.481802 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=5 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.482617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=11 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:42:19.488105 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.488579 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.489036 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.489863 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:19.490341 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:19.490764 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:19.644293 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:19.652634 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-36ae3a12-edd3-479f-b406-98aee2ea4a75 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1752 microversion: 2.1 time: 0.177993 Nov 02 12:42:19.653231 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 525/1030] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:19 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:20.677976 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:20.678673 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:20.684849 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.685357 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.685793 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.686512 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:20.687004 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:20.687458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:20.832898 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:20.840966 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-97522ba2-5d97-448d-923b-aa64dab10f46 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.168360 Nov 02 12:42:20.841574 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 506/1031] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:20 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:21.865062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:21.865701 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:21.873979 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.874469 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.874913 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:21.875624 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:21.876081 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:21.876504 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:22.028196 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:22.036927 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-d0e81910-9786-4a4a-8109-1d0297d7eb99 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.176197 Nov 02 12:42:22.037528 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 526/1032] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:21 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:23.059620 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:23.060208 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:23.066728 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.067201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.067632 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.068307 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:23.068752 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:23.069197 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:23.210303 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:23.218496 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-35125d61-f75d-4ac9-9c06-08e200c8626d tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.162686 Nov 02 12:42:23.219330 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 507/1033] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:23 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:24.242493 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:24.243160 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:24.249502 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.249990 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.250425 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.252072 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:24.252206 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:24.252574 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:24.394325 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:24.402581 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-62e7175a-c63e-4fef-abf4-42c2f4ae2701 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.164221 Nov 02 12:42:24.403144 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 527/1034] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:24 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:25.426482 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:25.427195 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:25.433549 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.434025 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.434458 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.435145 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:25.435596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:25.436015 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:25.582144 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:25.590372 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-2f352a7b-6572-43f4-bf3c-0d4c918bd370 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.168214 Nov 02 12:42:25.590940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 508/1035] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:25 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:26.613840 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:26.614518 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:26.621186 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.621773 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.622220 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.622921 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:26.623374 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:26.623801 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:26.769282 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:26.777852 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-db6e0bb4-c8eb-45d1-ae22-1ba139900840 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.168106 Nov 02 12:42:26.778434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 528/1036] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:26 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:27.801706 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:27.802377 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:27.809052 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.809603 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.810036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.810733 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:27.811256 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:27.811684 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:27.958232 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:27.966634 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-e0ec0fe0-5558-4067-b87e-3e19d1548d6e tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.168996 Nov 02 12:42:27.967201 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 509/1037] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:27 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:28.991910 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:28.992522 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:28.998906 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:28.999391 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:28.999825 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.001062 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:29.001516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:29.001944 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:29.142769 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:29.151156 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-c5969466-f6f5-4fbd-aefb-821d5eb71117 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.163609 Nov 02 12:42:29.151718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 529/1038] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:28 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:30.174030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:30.174621 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:30.181048 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:30.181525 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:30.181948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:30.182624 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:30.183065 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:30.183479 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:30.330888 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:30.339112 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-81680f69-f6dd-4c0b-856f-1bed947363eb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1757 microversion: 2.1 time: 0.168913 Nov 02 12:42:30.339665 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 510/1039] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:30 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1757 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:42:31.362827 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:42:31.363558 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:42:31.370317 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:31.370803 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:31.371233 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.371926 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:42:31.372372 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:42:31.372790 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:42:31.517870 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:42:31.526360 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-24346049-2ca5-4ed1-88da-b019652f95ce tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1760 microversion: 2.1 time: 0.168016 Nov 02 12:42:31.526932 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 530/1040] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:42:31 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1760 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:03.995007 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1390247077"}} {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:03.995655 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:03.997862 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_api:SELECT=12 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:03.998532 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG dbcounter [-] [120740] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120740) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:04.005010 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:04.005494 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:04.005931 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.006623 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:04.007073 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:04.007537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.135396 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.network.security_group_api [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Removing security group 1018f7de-3970-4e76-aa57-ce041733c74a from port 958295e8-1c3b-4281-9b06-162fe002d30e Nov 02 12:43:04.689233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9168d706-eb7d-46be-80d7-2f16ccf4aabc tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action" status: 202 len: 0 microversion: 2.1 time: 0.698027 Nov 02 12:43:04.693299 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 511/1041] 10.222.0.85 () {60 vars in 1278 bytes} [Wed Nov 2 12:43:03 2022] POST /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/action => generated 0 bytes in 700 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Nov 02 12:43:04.699947 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:04.706091 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_api:SELECT=12 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:04.706730 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG dbcounter [-] [120739] Writing DB stats nova_cell1:SELECT=36 {{(pid=120739) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Nov 02 12:43:04.725628 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:04.726024 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:04.726459 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:04.750925 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] Creating event network-changed:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:43:04.756143 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-82dbba24-227f-491e-bb05-fa8277e1e8a9 req-9262b00e-fa2e-42be-a95e-0ebd5b85856c service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060361 Nov 02 12:43:04.756753 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 531/1042] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:05.910167 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:05.910819 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:05.912887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:05.917066 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:05.917821 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:05.918252 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:05.918948 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:05.919561 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:05.919980 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:05.923460 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:05.924237 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:05.924899 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:05.937155 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] Creating event network-changed:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:43:05.942745 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-d49bcc1d-2e7c-49f4-a864-ba694f02ad12 req-16476f22-996d-4296-ad71-43bf099e0b34 service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034534 Nov 02 12:43:05.943682 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 532/1043] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Nov 02 12:43:06.005431 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lazy-loading 'services' on Instance uuid ba3c00b7-517d-4fd2-9a39-6682d3e10f3d {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:06.087880 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-dc3a14fc-c442-465d-848f-55565227528c tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0" status: 202 len: 0 microversion: 2.1 time: 0.182476 Nov 02 12:43:06.088831 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 512/1044] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:43:05 2022] DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0 => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Nov 02 12:43:06.099552 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:06.102250 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:06.110487 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.112211 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.113344 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.114526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:06.115076 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:06.115849 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:06.153521 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-6d1f8eb3-ff7d-4258-b838-6c84dcff0471 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058631 Nov 02 12:43:06.165566 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 533/1045] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:43:06 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:07.163325 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:43:07.163873 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: Wed Nov 2 12:43:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments (ip 10.222.0.85) !!! Nov 02 12:43:07.170644 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.172945 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.183597 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.184076 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.184509 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.185242 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.185694 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.186116 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.215233 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-8c282dd6-8978-4b18-92e9-2eef8fcedd35 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053131 Nov 02 12:43:07.215809 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 513/1046] 10.222.0.85 () {58 vars in 1302 bytes} [Wed Nov 2 12:43:07 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Nov 02 12:43:07.226262 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:07.226774 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:07.229372 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Nov 02 12:43:07.229516 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Wed Nov 2 12:43:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0 (ip 10.222.0.85) !!! Nov 02 12:43:07.236937 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.237645 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.238275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.239138 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:07.239857 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:07.240720 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:07.319466 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] HTTP exception thrown: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d is not attached to volume 20ad8711-91c4-44ff-97a2-139605d948d0 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Request method failure captured: Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0 HTTP/1.1 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmVoO1ANwefXHqZVGU_1POMrbEOGLn9KBvmbJKtp7EIx62eotEychc8z0Azy_ZMBoFTNa-iVUTVEcTu5z-aAKCqUsph0KN0FZscih-rFotOP7HGeEz8ybYp6SKZEuOlJQWNsOoILMpWBLWDp8rg1O93ENbUDQbOWS-WZoEqWx0N3qjc Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: fc45d759676e41178c93f56305f41958 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:43:07.321887 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc45d759676e41178c93f56305f41958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc45d759676e41178c93f56305f41958"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc45d759676e41178c93f56305f41958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc45d759676e41178c93f56305f41958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: fc45d759676e41178c93f56305f41958 Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-1512368839-project Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 88eb3c1d9e63402b8d045bc2f9e4d91a Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-1512368839-project Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:43:07.323726 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d is not attached to volume 20ad8711-91c4-44ff-97a2-139605d948d0 Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'server_id': 'ba3c00b7-517d-4fd2-9a39-6682d3e10f3d', 'id': '20ad8711-91c4-44ff-97a2-139605d948d0'} Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 20ad8711-91c4-44ff-97a2-139605d948d0. Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:07.324917 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d is not attached to volume 20ad8711-91c4-44ff-97a2-139605d948d0 Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d is not attached to volume 20ad8711-91c4-44ff-97a2-139605d948d0 Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:07.326617 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Returning 404 to user: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d is not attached to volume 20ad8711-91c4-44ff-97a2-139605d948d0 {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:07.328608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-9a77ef1d-fc3a-4c4a-ac61-76b9649387ef tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0" status: 404 len: 154 microversion: 2.1 time: 0.100989 Nov 02 12:43:07.328608 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 534/1047] 10.222.0.85 () {58 vars in 1416 bytes} [Wed Nov 2 12:43:07 2022] DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d/os-volume_attachments/20ad8711-91c4-44ff-97a2-139605d948d0 => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:08.465851 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:08.466338 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:08.473098 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.473589 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.474030 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.474732 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.475190 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.475609 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.501622 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Going to try to terminate instance {{(pid=120740) delete /opt/stack/nova/nova/compute/api.py:2719}} Nov 02 12:43:08.576447 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-50bb63a4-49d6-46db-8acf-4bb920878af6 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 204 len: 0 microversion: 2.1 time: 0.113933 Nov 02 12:43:08.580246 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 514/1048] 10.222.0.85 () {58 vars in 1239 bytes} [Wed Nov 2 12:43:08 2022] DELETE /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Nov 02 12:43:08.587641 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:08.588278 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:08.595713 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.596125 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.596614 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.597270 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:08.597718 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:08.598135 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:08.732936 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.policy [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120739) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:08.741194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-3706e3a1-9ae5-486f-ae6f-1cd4fce3db70 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1554 microversion: 2.1 time: 0.157374 Nov 02 12:43:08.741765 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 535/1049] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:08 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Nov 02 12:43:09.765969 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:09.766669 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:09.772986 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.773500 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.773940 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.774635 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:09.775088 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:09.775514 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:09.908038 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:09.916200 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-1f85d2b8-3609-42ed-9fd0-1621a7efac8a tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1554 microversion: 2.1 time: 0.155008 Nov 02 12:43:09.916774 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 515/1050] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:09 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:10.721368 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba3c00b7-517d-4fd2-9a39-6682d3e10f3d", "name": "network-vif-deleted", "tag": "958295e8-1c3b-4281-9b06-162fe002d30e"}]} {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Nov 02 12:43:10.731167 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.731650 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.732075 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.744194 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.compute.server_external_events [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] Creating event network-vif-deleted:958295e8-1c3b-4281-9b06-162fe002d30e for instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d on hv-cinder-86327 Nov 02 12:43:10.749904 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [req-b8937a7b-c645-4572-af3a-40ccc08ff146 req-cd811f5f-407b-4c74-94ff-3d4e83e00bfa service nova] 10.222.0.85 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031571 Nov 02 12:43:10.750506 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 536/1051] 10.222.0.85 () {64 vars in 1317 bytes} [Wed Nov 2 12:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Nov 02 12:43:10.939916 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:10.940590 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.compute.api [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120740) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:10.947036 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.947511 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.947944 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.948631 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.949123 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.949537 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.980917 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:10.981420 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:10.981855 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG oslo_concurrency.lockutils [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120740) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:10.982298 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.objects.instance [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lazy-loading 'fault' on Instance uuid ba3c00b7-517d-4fd2-9a39-6682d3e10f3d {{(pid=120740) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Nov 02 12:43:11.025596 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.policy [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '88eb3c1d9e63402b8d045bc2f9e4d91a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc45d759676e41178c93f56305f41958', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120740) authorize /opt/stack/nova/nova/policy.py:199}} Nov 02 12:43:11.035850 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-13a3fff1-0107-4748-894b-400afda7e984 tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 200 len: 1348 microversion: 2.1 time: 0.099787 Nov 02 12:43:11.036460 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 516/1052] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:10 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 1348 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Nov 02 12:43:12.060434 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '>' {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:12.061185 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.compute.api [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] [instance: ba3c00b7-517d-4fd2-9a39-6682d3e10f3d] Fetching instance by UUID {{(pid=120739) get /opt/stack/nova/nova/compute/api.py:2975}} Nov 02 12:43:12.067876 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.068362 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.068797 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.069526 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Acquiring lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Nov 02 12:43:12.069977 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Nov 02 12:43:12.070397 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG oslo_concurrency.lockutils [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Lock "3f9cbd8b-c305-4366-bd03-4bc429eae6e9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120739) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Nov 02 12:43:12.083652 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.wsgi [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] HTTP exception thrown: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Request method failure captured: Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: request: GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d HTTP/1.1 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept: application/json Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Accept-Encoding: identity Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Connection: close Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Length: 0 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Content-Type: application/json Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Host: 10.222.0.85 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: Openstack-System-Scope: None Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: User-Agent: python-urllib3/1.26.12 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Auth-Token: gAAAAABjYmVoO1ANwefXHqZVGU_1POMrbEOGLn9KBvmbJKtp7EIx62eotEychc8z0Azy_ZMBoFTNa-iVUTVEcTu5z-aAKCqUsph0KN0FZscih-rFotOP7HGeEz8ybYp6SKZEuOlJQWNsOoILMpWBLWDp8rg1O93ENbUDQbOWS-WZoEqWx0N3qjc Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Id: None Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Domain-Name: None Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Identity-Status: Confirmed Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Is-Admin-Project: True Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Id: default Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Domain-Name: Default Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Id: fc45d759676e41178c93f56305f41958 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Project-Name: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Role: member,reader Nov 02 12:43:12.085593 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Roles: member,reader Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.85:8080", "publicURL": "http://10.222.0.85:8080/v1/AUTH_fc45d759676e41178c93f56305f41958"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2/fc45d759676e41178c93f56305f41958"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc45d759676e41178c93f56305f41958"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/volume/v3/fc45d759676e41178c93f56305f41958"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.85/placement"}]}] Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Id: fc45d759676e41178c93f56305f41958 Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1512368839 Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User: tempest-TestMinimumBasicScenario-1512368839-project Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Id: default Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Domain-Name: Default Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Id: 88eb3c1d9e63402b8d045bc2f9e4d91a Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: X-User-Name: tempest-TestMinimumBasicScenario-1512368839-project Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: method: > Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: exception: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. Nov 02 12:43:12.087495 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: action_args: {'id': 'ba3c00b7-517d-4fd2-9a39-6682d3e10f3d'} Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: {{(pid=120739) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Nov 02 12:43:12.088527 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = self._get_server( Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. Nov 02 12:43:12.090275 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: ERROR nova.api.openstack.wsgi Nov 02 12:43:12.091837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: DEBUG nova.api.openstack.wsgi [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Returning 404 to user: Instance ba3c00b7-517d-4fd2-9a39-6682d3e10f3d could not be found. {{(pid=120739) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Nov 02 12:43:12.091837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: INFO nova.api.openstack.requestlog [None req-451205f5-ec69-41fa-9c98-e694c77cbfeb tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d" status: 404 len: 111 microversion: 2.1 time: 0.031722 Nov 02 12:43:12.091837 dv-cinder-863273-1-iscsi devstack@n-api.service[120739]: [pid: 120739|app: 0|req: 537/1053] 10.222.0.85 () {58 vars in 1236 bytes} [Wed Nov 2 12:43:12 2022] GET /compute/v2.1/servers/ba3c00b7-517d-4fd2-9a39-6682d3e10f3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Nov 02 12:43:12.097106 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: DEBUG nova.api.openstack.wsgi [None req-9d33374a-cc5d-4697-ae5d-a38e519ff3ab tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] Calling method '.version_select at 0x7faf06870f70>' {{(pid=120740) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Nov 02 12:43:12.117093 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: INFO nova.api.openstack.requestlog [None req-9d33374a-cc5d-4697-ae5d-a38e519ff3ab tempest-TestMinimumBasicScenario-1512368839 tempest-TestMinimumBasicScenario-1512368839-project] 10.222.0.85 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1535183324" status: 202 len: 0 microversion: 2.1 time: 0.023800 Nov 02 12:43:12.117733 dv-cinder-863273-1-iscsi devstack@n-api.service[120740]: [pid: 120740|app: 0|req: 517/1054] 10.222.0.85 () {58 vars in 1272 bytes} [Wed Nov 2 12:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1535183324 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)